-- Logs begin at Wed 2022-07-20 13:06:28 UTC, end at Wed 2022-07-20 14:37:03 UTC. -- Jul 20 13:37:49.058681 dv-cinder-819149-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 13:37:49.067615 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 13:37:49 2022] *** Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: nodename: dv-cinder-819149-11-iscsi Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: machine: x86_64 Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: clock source: unix Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: pcre jit disabled Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: detected number of CPU cores: 4 Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: current working directory: / Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: detected binary path: /usr/bin/uwsgi-core Jul 20 13:37:49.069492 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: your processes number limit is 47680 Jul 20 13:37:49.070153 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: your memory page size is 4096 bytes Jul 20 13:37:49.070153 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: detected max file descriptor number: 2048 Jul 20 13:37:49.070153 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: lock engine: pthread robust mutexes Jul 20 13:37:49.070153 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: thunder lock: enabled Jul 20 13:37:49.070153 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 13:37:49.070153 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 13:37:49.113349 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: Python main interpreter initialized at 0x56303b3b09c0 Jul 20 13:37:49.113349 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: python threads support enabled Jul 20 13:37:49.113349 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: your server socket listen backlog is limited to 100 connections Jul 20 13:37:49.113349 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: your mercy for graceful operations on workers is 90 seconds Jul 20 13:37:49.113677 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 13:37:49.113752 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: *** Operational MODE: preforking *** Jul 20 13:37:49.113997 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: *** uWSGI is running in multiple interpreter mode *** Jul 20 13:37:49.113997 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: spawned uWSGI master process (pid: 114982) Jul 20 13:37:49.114169 dv-cinder-819149-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 13:37:49.115175 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: spawned uWSGI worker 1 (pid: 114983, cores: 1) Jul 20 13:37:49.115175 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: spawned uWSGI worker 2 (pid: 114984, cores: 1) Jul 20 13:37:49.115175 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 13:37:49.772562 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 13:37:49.783042 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 13:37:50.887141 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:37:50.887141 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: from cryptography.utils import int_from_bytes Jul 20 13:37:50.887711 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:37:50.887711 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: from cryptography.utils import int_from_bytes Jul 20 13:37:50.890077 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:37:50.890077 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: from cryptography.utils import int_from_bytes Jul 20 13:37:50.890546 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:37:50.890546 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: from cryptography.utils import int_from_bytes Jul 20 13:37:53.356843 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 13:37:53.357513 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 13:37:53.357677 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 13:37:53.358007 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 13:37:53.358257 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 13:37:53.358572 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 13:37:53.358945 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.359041 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 13:37:53.359123 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.359247 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.359334 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 13:37:53.359559 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.359685 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 13:37:53.359882 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.359966 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 13:37:53.360183 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.360337 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.360515 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.360688 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.360823 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.361010 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.361140 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.361330 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.361417 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.361663 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.361759 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.361969 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.362064 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-11-iscsi {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.362284 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.362375 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.362581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.362673 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.362891 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.362990 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.363157 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.363242 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.363465 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.363550 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.363786 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-11-iscsi {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.363873 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.364080 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.364163 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.364423 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.364607 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.364731 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.365799 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.365932 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366039 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366126 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366126 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366342 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366342 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366538 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366538 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366746 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366855 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.366944 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367036 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367117 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367195 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367327 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367420 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367585 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367672 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.367893 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.368063 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-11-iscsi {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.368212 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.368400 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.368533 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.368704 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.368836 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.369009 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.369157 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.369411 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.369497 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.369716 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.369848 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-11-iscsi {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.370016 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.370157 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.370326 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.370464 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.370640 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.370773 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.370956 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.371180 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.371269 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.371496 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.371595 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.371803 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.371890 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.372120 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.372237 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.372447 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.372533 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.372754 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.372853 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.373055 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.373143 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.373906 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.373994 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.374204 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.374305 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.374501 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.374640 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.374745 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.374880 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.375047 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.375186 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.375359 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.375488 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.375672 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.375801 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.375986 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.376085 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.376252 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.376412 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.376509 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.376661 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.376800 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.376965 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.377111 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.377282 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.377411 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.377597 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.377711 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.377912 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.378009 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.378161 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.378296 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.378410 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.378594 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.378724 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.378901 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.379078 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.379181 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.379328 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.379474 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.379629 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.379785 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.379930 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.380090 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.380252 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.380428 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.380555 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.380731 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.380859 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.381042 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.381161 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.381430 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.381523 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.381675 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.381762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.381978 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.382071 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.382309 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.382402 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.382620 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.382715 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.382925 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.383011 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.383236 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.383321 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.383552 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.383651 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.383854 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.383955 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.384151 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.384291 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.384474 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.384569 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.384787 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.384873 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.385107 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.385191 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.385403 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.385495 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.385647 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.385736 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.385943 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.386035 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.386241 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.386328 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.386550 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.386646 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.386849 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.386936 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.387148 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.387235 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.387443 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.387527 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.387735 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.387818 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.388035 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.388121 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.388358 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.388446 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.388659 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.388745 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.389529 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.389643 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.389840 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.389934 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.390176 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.390324 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.390484 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.390571 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.390789 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.390873 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.391085 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.391225 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.391389 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.391475 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.391691 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.391776 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.392011 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.392113 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.392310 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.392398 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.392611 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.392753 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.392912 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.393019 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.393224 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.393308 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.393524 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.393609 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.393824 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.393991 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.394125 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.394211 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.394424 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.394508 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.394725 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.394823 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.395033 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.395122 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.395334 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.395419 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.395631 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.395723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.395942 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.396028 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.396256 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.396349 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.396559 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.396665 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.396869 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.396954 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.397169 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.397253 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.397467 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.397569 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.397763 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.397855 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.398061 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.398147 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.398356 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.398443 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.398653 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.398785 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.398949 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.399035 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.399246 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.399342 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.399539 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.399625 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.399837 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.399921 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.400138 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.400239 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.400466 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.400556 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.400763 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.400849 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.401061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.401149 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.401354 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.401442 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.401670 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.401765 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.401998 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.402084 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.402303 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.402388 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.402609 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.402704 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.402911 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.402998 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.403226 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:37:53.403312 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.403554 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.403647 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.403861 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.403947 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.404170 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.404304 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.404540 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.404637 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.404847 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.404941 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.405151 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.405241 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.405456 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.405543 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.405769 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.405855 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.406084 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.406169 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.406407 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.406501 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.406716 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.406809 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.407022 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.407132 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.407331 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.407419 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.407634 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.407718 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.407947 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.408032 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.408293 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.408402 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.408608 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.408695 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.408913 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.409011 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.409227 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.409322 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.409535 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.409628 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.409851 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.409939 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.410166 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.410252 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.410479 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.410564 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.410781 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.410875 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.411083 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.411176 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.411386 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.411478 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.411699 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.411795 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.412023 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.412117 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.412354 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.412444 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.412667 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.412767 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.412975 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.413062 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.413276 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.413361 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.413578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.413674 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.413881 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.413973 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.414184 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.414277 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.414504 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.414590 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.414808 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.414892 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.415115 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.415200 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.415420 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.415514 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.415726 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.415812 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.416030 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.416125 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.416362 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.416452 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.416667 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.416753 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.416964 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.417057 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.417259 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.417353 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.417557 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.417643 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.417870 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.417964 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.418184 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.418270 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.418494 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.418594 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.418799 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.418894 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.419099 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.419207 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.419398 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.419496 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.419705 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.419856 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.420018 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.420105 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.420353 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.420445 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.420660 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.420764 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.420959 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.421045 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.421264 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.421351 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.421568 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.421659 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.421866 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.421953 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.422176 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.422261 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.422477 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.422574 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.422777 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.422863 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.423088 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.423173 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.423384 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.423470 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.423681 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.423774 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.423988 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.424074 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.424315 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.424405 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.424619 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.424706 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.424927 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.425014 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.425226 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.425320 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.425529 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.425615 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.425831 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.425964 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.426164 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.426291 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.426446 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.426560 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.426758 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.426858 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.427058 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.427144 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.427377 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.427462 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.427685 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.427785 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.427993 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.428077 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.428323 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.428424 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.428629 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.428717 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.428925 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.429008 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.429224 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.429321 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.429518 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.429606 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.429819 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.429915 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.430116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.430202 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.430413 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.430500 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.430709 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.430804 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.431001 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.431088 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.431296 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.431385 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.431612 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.431711 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.431910 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.432029 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.432229 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.432320 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.432524 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.432610 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.432823 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.432921 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.433125 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.433212 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.433437 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.433521 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.433740 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.433834 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.434044 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.434130 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.434347 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.434434 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.434649 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.434744 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.434976 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.435071 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.435276 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.435411 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.435615 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.436229 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.436509 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.436608 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.436825 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.436918 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.437134 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.437223 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.437443 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.437530 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.437748 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.437860 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.438058 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.438146 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.438370 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.438457 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.438681 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.438768 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.438994 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.439082 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.439318 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.439467 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.439605 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.439748 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.439894 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.440038 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.440253 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.440393 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.440577 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.440725 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.440888 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.441034 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.441206 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.441340 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.441510 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.441672 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.441824 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.441931 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.442118 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.442211 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.442425 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.442521 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.442732 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.442818 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.443038 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.443134 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.443359 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.443459 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.443666 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.443760 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.443975 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.444068 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.444299 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.444388 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.444615 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.444701 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.444920 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.445005 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.445235 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.445329 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.445536 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.445625 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.445844 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.445930 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.446148 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.446235 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.446472 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.446558 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.446773 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.446858 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.447081 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.447175 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.447382 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.447467 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.447685 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.447768 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.448266 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.448375 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.448576 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.448665 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.448877 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.448973 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.449177 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.449318 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.449480 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.449575 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.449788 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.449884 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.450092 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.450187 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.450394 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.450480 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.450690 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.450786 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.450991 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.451077 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.451313 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.451899 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.452153 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.452270 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.452491 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.452589 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.452799 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.452886 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.453104 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.453198 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.453413 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.453505 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.453718 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.453811 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.454022 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.454109 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.454318 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.454410 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.454616 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.454703 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.454933 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.455020 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.455234 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.455320 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.455531 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.455618 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.455828 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.455916 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.456125 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.456261 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.456474 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.456622 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.456775 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.456860 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.457070 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.457157 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.457378 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.457472 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.457681 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.457768 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.457982 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.458067 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.458288 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.458393 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.458589 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.458681 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.458888 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.458975 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.459200 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.459295 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.459505 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.459600 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.459803 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.459889 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.460109 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.460217 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.460438 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.460535 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.460744 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.460836 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.461048 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.461144 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.461355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.461442 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.461653 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.461738 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.461957 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.462051 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.462261 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.462363 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.462558 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.462645 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.462862 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.462957 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.463175 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.463262 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.463477 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.463735 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.463824 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.464061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.464148 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.464393 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.464481 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.464703 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.464800 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.465012 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.465097 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.465325 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.465570 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.465713 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.465904 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.465991 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.466222 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.466308 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.466542 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.466643 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.466862 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.466959 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.467192 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.467284 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.467491 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.467578 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.467795 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.467883 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.468093 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.468180 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.468418 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.468515 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.468716 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.468882 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469019 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469107 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469316 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469411 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469614 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469720 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469908 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.469995 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.470203 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.470290 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.470504 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.470590 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.470797 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.470882 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.471098 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.471189 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.471392 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.471479 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.471691 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.471776 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.471991 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.472083 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.472326 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.472434 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.472625 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.472713 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.472936 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.473024 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.473237 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.473347 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.473553 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.473640 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.473859 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.473960 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.474161 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.474257 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.474461 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.474583 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.474761 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.474880 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.475097 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.475184 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.475398 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.475485 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.475730 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.475830 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.476042 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.476129 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.476375 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.476463 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.476676 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.476775 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.476976 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.477064 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.477271 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.477357 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.477574 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.477661 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.477871 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.477957 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.478169 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.478256 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.478466 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.478558 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.478760 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.478847 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.479056 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.479148 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.479348 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.479441 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.479654 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.479750 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.479952 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.480039 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.480270 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.480365 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.480566 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.480653 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.480866 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.480966 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.481164 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.481250 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.481458 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.481551 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.481757 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.481853 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.482054 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.482141 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.482357 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.482444 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.482680 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.482776 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.482977 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.483075 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.483276 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.483363 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.483575 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.483670 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.483875 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.483962 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.484168 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.484317 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.484498 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.484593 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.484799 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.484886 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.485094 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.485180 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.485390 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.485486 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.485692 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.485780 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.485990 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.486087 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.486287 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.486382 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.486587 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.486674 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.486890 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.486976 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.487192 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.487279 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.487484 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.487570 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.487787 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.487882 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.488083 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.488170 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.488412 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.488500 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.488733 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.488838 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.489045 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.489132 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.489345 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.489432 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.489705 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.489815 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.489932 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.490020 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.490229 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.490305 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.490526 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.490633 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.490839 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.490934 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.491135 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.491223 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.491432 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.491527 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.491727 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.491813 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.492021 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.492180 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.492385 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.492484 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.492685 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.492780 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.493029 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.493123 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.493332 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.493420 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.493632 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.493718 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.493933 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.494021 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.494237 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.494324 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.494543 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.494630 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.494851 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.494952 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.495147 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.495233 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.495454 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.495542 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.495758 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.495854 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.496061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.496261 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.496382 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.496579 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.496667 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.496892 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.496982 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.497194 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.497280 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.497504 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.497598 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.497813 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.497902 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.498140 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.498735 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.498951 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.499038 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.499252 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.499348 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.499554 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.499641 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.499860 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.499965 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.500161 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.500263 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.500487 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.500584 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.500788 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.500886 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.501093 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.501264 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.501391 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.501687 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.501803 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.501991 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.502133 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.502296 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.502454 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.502594 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.502766 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.502893 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.503076 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.503197 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.503384 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.503494 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.503697 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.503809 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.504009 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.504104 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.504345 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.504436 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.504659 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.504738 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.504971 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.505047 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.505271 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.505345 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.505567 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.505644 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.505871 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.506065 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.506176 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.506285 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.506497 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.506582 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.506805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.506882 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.507108 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.507196 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.507414 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.507491 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.507716 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.507791 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.508024 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.508108 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.508345 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.508435 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.508758 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.508834 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.509064 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.509148 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.509370 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.509452 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.509675 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.509749 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.509969 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.510054 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.510264 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.510338 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.510567 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.510654 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.510882 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.510957 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.511259 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.511350 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.511465 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.511586 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.511759 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.511896 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.512074 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.512225 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.512405 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.512541 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.512717 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.512843 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.513126 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.513202 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.513429 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.513512 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.514055 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.514654 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.514654 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.514788 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.514879 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.514965 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.515180 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.515257 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.515498 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.515574 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.515801 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.515886 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.516118 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.516233 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.516479 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.516555 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.516787 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.516879 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.517137 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.517236 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.517405 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.517535 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.517722 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.517842 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.518027 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.518150 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.518335 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.518470 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.518632 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.518789 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.518947 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.519109 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.519264 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.519409 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.519569 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.519718 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.519884 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.520024 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.520312 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.520416 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.520631 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.520719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.520938 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.521025 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.521254 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.521353 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.521568 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.521644 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.521863 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.521940 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.522159 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.522235 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.522461 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.522536 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.522757 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.522835 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.523056 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.523202 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.523378 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.523523 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.523675 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.523832 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.523978 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.524260 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.524350 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.524496 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.524582 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.524802 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.524899 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.525104 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.525192 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.525414 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.525502 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.525718 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.525805 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.526023 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.526117 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.526330 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.526417 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.526629 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.526705 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.526941 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.527026 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.527237 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.527314 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.527550 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.527627 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.527910 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.528018 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.528144 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.528255 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.528467 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.528564 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.528763 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.528864 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.529096 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.529184 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.529413 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.529535 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.529729 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.529869 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.530051 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.530192 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.530374 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.530496 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.530677 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.530817 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.531000 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.531126 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.531337 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.531445 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.531624 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.531721 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.531935 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.532078 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.532276 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.532370 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.532574 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.532671 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.532869 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.532955 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.533174 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.533275 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.533472 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.533606 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.533770 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.533915 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.534065 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.534247 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.534364 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.534574 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.534653 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.534890 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.534975 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.535207 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.535285 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.535521 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.535597 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.535818 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.535894 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.536116 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.536209 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.536448 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.536526 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.536893 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537034 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537117 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537186 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537348 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537496 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537651 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537753 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.537953 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.538041 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.538254 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.538340 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.538578 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.538685 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.538878 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.538976 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.539180 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.539276 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.539498 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.539610 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.539804 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.539909 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.540108 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.540226 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.540437 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.540528 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.543707 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.543794 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.543794 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.543960 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544054 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544135 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544239 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544332 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544414 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544491 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544665 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544751 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544831 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.544909 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.545004 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.545598 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.545680 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.545680 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.545812 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.545890 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.545968 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546126 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546210 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546289 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546367 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546452 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546546 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546639 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546721 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546815 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546883 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.546948 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547026 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547114 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547194 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547271 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547349 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547427 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547513 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547513 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547664 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.547742 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549041 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549163 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549255 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549337 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549424 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549513 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549593 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549681 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549841 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549920 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.549999 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550077 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550165 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550248 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550328 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550407 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550486 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550573 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550711 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.550958 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.551064 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.551230 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.551319 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.551555 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.551643 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.551886 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.551972 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.552269 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.552373 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.552515 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.552602 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.552818 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557108 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557205 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557301 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557385 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557464 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557552 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557633 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557719 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557808 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557889 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.557980 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558060 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558139 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558305 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558403 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558480 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558566 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558647 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558726 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558726 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558880 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.558966 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559121 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559211 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559292 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559380 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559468 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559548 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559634 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559715 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559806 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559886 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.559965 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560042 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560121 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560121 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560288 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560370 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560449 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560527 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560605 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560704 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.560837 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.561429 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566117 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566215 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566296 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566375 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566469 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566559 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566641 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566720 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566720 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566876 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.566876 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567010 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567076 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567142 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567207 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567281 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567360 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567437 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567522 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567680 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567766 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567852 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.567932 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568010 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568088 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568165 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568328 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568422 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568503 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568581 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568659 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568745 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568826 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568912 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568992 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.568992 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569133 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569220 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569307 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569388 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569465 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569543 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569628 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569720 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569801 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569880 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.569958 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570036 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570127 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570208 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570287 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570366 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570443 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570520 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570606 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570686 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570771 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570851 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.570928 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571008 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571094 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571175 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571252 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571338 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571423 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571511 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571633 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571768 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.571918 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572016 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572100 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572238 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572325 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572405 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572405 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572549 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572628 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572727 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572727 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.572874 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573220 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573315 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573414 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573506 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573605 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573687 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573885 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.573985 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.574189 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.574294 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.574492 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.574803 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.574944 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.575103 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.575259 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.575408 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.575574 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.575710 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.575919 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.576020 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.576274 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.576385 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.576655 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.576814 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.577002 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.577193 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.577315 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.577460 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.577615 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.577791 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.577916 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.578116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.578218 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.578417 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.578526 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.578718 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.578819 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.579018 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.579119 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.579335 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.579427 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.579639 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.579753 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.579943 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.580068 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.580271 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.580576 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.580679 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.580879 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.581065 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.581184 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.581275 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.581489 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.581594 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.581789 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.581910 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.582092 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.582188 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.582393 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.582484 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.582694 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.582806 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.582999 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.583091 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.583305 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.583404 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.583611 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.583713 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.583931 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.584031 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.584264 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.584367 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.584573 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.584660 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.584881 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.584968 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.585187 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.585281 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.585489 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.585582 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.585791 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.585877 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.586090 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.586184 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.586391 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.586479 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.586695 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.586788 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.587003 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.587123 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.587311 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.587431 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.587610 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.587723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.587949 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.588048 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.588292 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.588392 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.588609 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.588707 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.588925 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.589023 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.589232 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.589330 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.589544 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.589640 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.589861 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.589960 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.590166 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.590265 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.590480 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.590577 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.590783 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.590880 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.591105 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.591202 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.591409 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.591519 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.591741 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.591838 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.592085 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.592245 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.592408 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.592508 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.592708 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.592811 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.593005 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.593104 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.593312 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.593425 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.593623 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.593714 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.593925 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.594045 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.594329 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.594438 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.594528 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.594622 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.594795 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.594887 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.595090 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.595212 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.595387 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.595539 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.595683 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.595862 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.595979 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.596165 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.596292 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.596491 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.596580 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.596795 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.596885 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.597102 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.597189 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.597422 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.597531 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.597722 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.597827 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.598016 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.598113 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.598315 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.598411 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.598610 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.598706 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.598911 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.599007 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.599207 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.599305 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.599504 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.599603 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.599797 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.599893 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.600099 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.600220 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.600421 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.600518 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.600720 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.600811 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.601022 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.601118 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.601323 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.601411 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.601624 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.601712 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.601922 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.602021 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.602229 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.602329 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.602536 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.602624 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.602840 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.602937 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.603140 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.603229 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.603443 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.603530 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.603741 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.603830 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.604049 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.604134 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.604385 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.604540 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.604687 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.604827 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.604966 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.605114 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.605296 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.605438 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.605586 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.605721 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.605868 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.606003 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.606167 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.606304 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.606485 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.606623 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.606797 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.606990 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.607142 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.607287 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.607429 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.608160 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.608299 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.608568 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.608671 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.608876 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.608985 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.609184 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.609272 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.609489 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.609665 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.609796 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.609885 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.610101 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.610189 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.610412 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.610514 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.610717 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.610818 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.611023 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.611130 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.611333 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.611448 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.611644 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.611748 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.611964 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.612062 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.612300 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.612404 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.612604 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.612695 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.612923 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.613023 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.613232 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.613324 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.613539 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.613634 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.613849 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.613950 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.614158 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.614247 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.614472 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.614581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.614782 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.614884 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.615085 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.615187 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.615383 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.615491 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.615621 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 13:37:53.615720 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.616004 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.616351 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.616665 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.616986 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.617311 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.617652 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.617964 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.618302 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.618629 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.618942 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.619255 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.619556 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:37:53.619800 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 13:37:53.676927 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO dbcounter [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Registered counter for database nova_api Jul 20 13:37:53.682669 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO dbcounter [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Registered counter for database nova_api Jul 20 13:37:53.790352 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_db.sqlalchemy.engines [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:53.794035 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_db.sqlalchemy.engines [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:53.797493 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writer thread running {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:53.800959 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writer thread running {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:53.852677 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.context [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6fdd732e-d85d-4c48-8292-9a17203a2e04(cell1) {{(pid=114984) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 13:37:53.856729 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_concurrency.lockutils [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:37:53.856953 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.context [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6fdd732e-d85d-4c48-8292-9a17203a2e04(cell1) {{(pid=114983) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 13:37:53.859117 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_concurrency.lockutils [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:37:53.859867 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_concurrency.lockutils [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:37:53.861561 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:37:53.862289 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_concurrency.lockutils [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:37:53.863154 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:37:53.863934 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:37:53.864327 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO dbcounter [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Registered counter for database nova_cell0 Jul 20 13:37:53.866088 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:37:53.868097 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO dbcounter [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Registered counter for database nova_cell0 Jul 20 13:37:53.868234 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO dbcounter [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Registered counter for database nova_cell1 Jul 20 13:37:53.872241 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO dbcounter [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Registered counter for database nova_cell1 Jul 20 13:37:53.877946 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_db.sqlalchemy.engines [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:53.879194 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_db.sqlalchemy.engines [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:53.880522 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_db.sqlalchemy.engines [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:53.884230 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_db.sqlalchemy.engines [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:53.885719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writer thread running {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:53.885919 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writer thread running {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:53.887951 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writer thread running {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:54.025272 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writer thread running {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:54.031745 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO dbcounter [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Registered counter for database nova_cell0 Jul 20 13:37:54.034681 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO dbcounter [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Registered counter for database nova_cell0 Jul 20 13:37:54.040542 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG oslo_db.sqlalchemy.engines [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:54.042147 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_db.sqlalchemy.engines [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:37:54.046002 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writer thread running {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:54.047001 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writer thread running {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:37:54.384206 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: WARNING keystonemiddleware.auth_token [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:37:54.388177 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: WARNING keystonemiddleware.auth_token [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:37:54.391893 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: WARNING keystonemiddleware.auth_token [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:37:54.396088 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: WARNING keystonemiddleware.auth_token [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:37:54.732155 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: WARNING keystonemiddleware.auth_token [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:37:54.737201 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: WARNING keystonemiddleware.auth_token [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:37:54.738102 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: WARNING keystonemiddleware.auth_token [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:37:54.743072 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: WARNING keystonemiddleware.auth_token [None req-f48750e3-909c-4068-83f3-9f25e9615a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:37:54.743325 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56303b3b09c0 pid: 114983 (default app) Jul 20 13:37:54.745382 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:37:54.746546 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001703 Jul 20 13:37:54.746950 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Jul 20 13:37:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:37:54.748838 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56303b3b09c0 pid: 114984 (default app) Jul 20 13:39:10.641122 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:10.642144 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 20 13:39:10.642564 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:10.655206 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writing DB stats nova_api:SELECT=3 {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:10.656477 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writing DB stats nova_cell1:SELECT=3 {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:10.657411 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writing DB stats nova_cell0:SELECT=3 {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:10.658168 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:11.493974 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4ecd3d2d-e625-4a4d-9f17-115cdb0efb4f admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:11.525008 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-4ecd3d2d-e625-4a4d-9f17-115cdb0efb4f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.875077 Jul 20 13:39:11.525780 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 13:39:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:13.825544 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:13.826533 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d521aabf-964b-4b1d-a37f-93055ab6006a None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001388 Jul 20 13:39:13.826941 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:14.268255 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-d36bf521-fcb4-4e3c-b73a-2f7c73caac9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 256}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:14.287118 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:39:14.287118 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: warnings.warn(msg) Jul 20 13:39:14.314851 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-d36bf521-fcb4-4e3c-b73a-2f7c73caac9c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481967 Jul 20 13:39:14.322803 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:39:14.538721 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-0bb32c07-6c79-45a1-b6c3-0cc3aaa8f2a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:14.541175 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:39:14.541175 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: warnings.warn(msg) Jul 20 13:39:14.543865 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_api:SELECT=3 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:14.546492 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_cell0:SELECT=3 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:14.547470 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_cell1:SELECT=3 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:14.548160 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:14.619288 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-0bb32c07-6c79-45a1-b6c3-0cc3aaa8f2a0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295110 Jul 20 13:39:14.627294 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 13:39:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:16.862997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-d36bf521-fcb4-4e3c-b73a-2f7c73caac9c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:16.864024 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-d36bf521-fcb4-4e3c-b73a-2f7c73caac9c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 20 13:39:16.864734 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:17.542618 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d744d335-9f0b-4690-baa7-9ea60dc7d61f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:17.561000 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:39:17.561000 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: warnings.warn(msg) Jul 20 13:39:17.582620 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d744d335-9f0b-4690-baa7-9ea60dc7d61f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712165 Jul 20 13:39:17.583693 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:17.597311 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-62e3213a-9083-46d9-93a0-2f04eb10490b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:17.599044 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:39:17.599044 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: warnings.warn(msg) Jul 20 13:39:17.633576 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-62e3213a-9083-46d9-93a0-2f04eb10490b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041426 Jul 20 13:39:17.634465 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 13:39:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:19.941234 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d744d335-9f0b-4690-baa7-9ea60dc7d61f admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:19.942947 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d744d335-9f0b-4690-baa7-9ea60dc7d61f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Jul 20 13:39:19.942947 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:20.343870 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-48b0f5cd-7e8c-43ef-af3d-8073a5c3414c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "name": "ds1G", "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:20.361410 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-48b0f5cd-7e8c-43ef-af3d-8073a5c3414c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.411719 Jul 20 13:39:20.362145 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:20.374050 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-e40f3407-619c-422d-a45f-0ee1e0e28cd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:20.395731 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-e40f3407-619c-422d-a45f-0ee1e0e28cd7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025516 Jul 20 13:39:20.396304 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 13:39:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:22.666586 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-48b0f5cd-7e8c-43ef-af3d-8073a5c3414c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:22.668197 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-48b0f5cd-7e8c-43ef-af3d-8073a5c3414c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Jul 20 13:39:22.668852 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:23.125124 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-ee2bb579-03cb-4ab3-97a1-5aedfcc14c8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:23.150417 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-ee2bb579-03cb-4ab3-97a1-5aedfcc14c8f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473445 Jul 20 13:39:23.151699 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:39:23.164006 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-74af6d96-6deb-4922-bd83-b4e666686518 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:23.199321 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-74af6d96-6deb-4922-bd83-b4e666686518 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038331 Jul 20 13:39:23.200646 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 13:39:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:25.451314 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-ee2bb579-03cb-4ab3-97a1-5aedfcc14c8f admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:25.452509 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-ee2bb579-03cb-4ab3-97a1-5aedfcc14c8f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 20 13:39:25.452910 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:25.875258 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-f5ad1160-b1dc-4fec-b02d-7bb9b0d873c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 20, "name": "ds4G"}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:25.893288 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-f5ad1160-b1dc-4fec-b02d-7bb9b0d873c0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434310 Jul 20 13:39:25.894010 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:25.905990 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-4b490b24-e9ba-4dbd-8715-4e6a52276a7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:25.931036 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-4b490b24-e9ba-4dbd-8715-4e6a52276a7e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028563 Jul 20 13:39:25.931936 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jul 20 13:39:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:39:28.166821 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-f5ad1160-b1dc-4fec-b02d-7bb9b0d873c0 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:28.168380 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-f5ad1160-b1dc-4fec-b02d-7bb9b0d873c0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Jul 20 13:39:28.168790 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:28.587298 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-a1120842-e202-4fb5-baef-98321166a78f admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:28.617292 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-a1120842-e202-4fb5-baef-98321166a78f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.442196 Jul 20 13:39:28.618054 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 13:39:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:39:30.884021 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-f5ad1160-b1dc-4fec-b02d-7bb9b0d873c0 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:30.885155 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-f5ad1160-b1dc-4fec-b02d-7bb9b0d873c0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 20 13:39:30.885503 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:31.340262 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-04ff3acb-b539-444a-9ceb-59eac0ba9441 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "disk": 1, "name": "m1.tiny"}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:31.358820 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-04ff3acb-b539-444a-9ceb-59eac0ba9441 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.466019 Jul 20 13:39:31.359397 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:31.375998 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-54861f62-edfe-4639-b0b1-f47637fd4047 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:31.403521 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-54861f62-edfe-4639-b0b1-f47637fd4047 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031930 Jul 20 13:39:31.404262 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 13:39:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:33.636688 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-04ff3acb-b539-444a-9ceb-59eac0ba9441 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:33.637731 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-04ff3acb-b539-444a-9ceb-59eac0ba9441 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Jul 20 13:39:33.638136 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:34.042426 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-5761d162-25b7-4ca3-9b0b-cfd29aadf4e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:34.059593 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-5761d162-25b7-4ca3-9b0b-cfd29aadf4e2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415594 Jul 20 13:39:34.060138 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:34.073008 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-b8b5d9ef-0822-496c-81ad-a25d6b63de46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:34.097200 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-b8b5d9ef-0822-496c-81ad-a25d6b63de46 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028977 Jul 20 13:39:34.097860 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 13:39:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:36.331105 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-5761d162-25b7-4ca3-9b0b-cfd29aadf4e2 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:36.332000 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-5761d162-25b7-4ca3-9b0b-cfd29aadf4e2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 20 13:39:36.332429 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:36.714051 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-a6f43fbd-b3fa-42fe-af3e-c8d934ae93e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:36.733666 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-a6f43fbd-b3fa-42fe-af3e-c8d934ae93e5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.395423 Jul 20 13:39:36.734320 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:36.747181 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-118c3c93-53ce-418f-860e-35cde4288064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:36.771519 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-118c3c93-53ce-418f-860e-35cde4288064 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029052 Jul 20 13:39:36.772306 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 13:39:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:39:39.039181 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-a6f43fbd-b3fa-42fe-af3e-c8d934ae93e5 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:39.040231 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-a6f43fbd-b3fa-42fe-af3e-c8d934ae93e5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jul 20 13:39:39.040643 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:39.527490 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-583b96ee-9faa-4935-a8e7-3b28c6017ec8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:39.547090 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-583b96ee-9faa-4935-a8e7-3b28c6017ec8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500381 Jul 20 13:39:39.555020 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:39.564284 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-210804e8-a2cb-4194-9d0c-df93b0b6d706 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:39.590585 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-210804e8-a2cb-4194-9d0c-df93b0b6d706 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034430 Jul 20 13:39:39.591147 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 13:39:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:39:41.852623 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-583b96ee-9faa-4935-a8e7-3b28c6017ec8 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:39:41.854311 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-583b96ee-9faa-4935-a8e7-3b28c6017ec8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jul 20 13:39:41.859630 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:39:42.295512 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-bb56ae51-e9c9-42fc-9b89-5e1b6304d4ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:42.317281 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-bb56ae51-e9c9-42fc-9b89-5e1b6304d4ed admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456450 Jul 20 13:39:42.318163 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jul 20 13:39:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:39:42.333928 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-ddb14fe4-baa0-4cac-acef-7a451ac2a9a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:39:42.337431 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:42.360730 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-ddb14fe4-baa0-4cac-acef-7a451ac2a9a1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030403 Jul 20 13:39:42.369008 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jul 20 13:39:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:40:01.925169 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-bb56ae51-e9c9-42fc-9b89-5e1b6304d4ed admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:01.926163 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-bb56ae51-e9c9-42fc-9b89-5e1b6304d4ed admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 20 13:40:01.926553 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:01.937868 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:02.318843 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-d58fa9d1-e357-47c3-91a9-834712eea5bd admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:02.336498 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-d58fa9d1-e357-47c3-91a9-834712eea5bd admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403299 Jul 20 13:40:02.340237 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 13:40:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:40:03.434481 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-bb56ae51-e9c9-42fc-9b89-5e1b6304d4ed admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:03.435483 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-bb56ae51-e9c9-42fc-9b89-5e1b6304d4ed admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 20 13:40:03.435916 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:03.957570 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4c24cae0-fa09-4b58-8550-e3c2f149dc69 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:03.963142 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.wsgi [None req-4c24cae0-fa09-4b58-8550-e3c2f149dc69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4c24cae0-fa09-4b58-8550-e3c2f149dc69 admin admin] Request method failure captured: Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Accept: application/json Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Accept-Encoding: gzip, deflate Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Connection: keep-alive Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Content-Length: 0 Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Host: 10.222.0.17 Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Openstack-Api-Version: compute 2.90 Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Openstack-System-Scope: None Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: User-Agent: python-novaclient Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Auth-Token: gAAAAABi2AWzLFNsRK5GQJ6m8-E50OiuR4X-GM80pI9FF8Oj95_I2LecxeYPchoJ_bSiZ_9l3VA7cZvplnp6wUUtNlmZNz2Z5AMHl4vx1LNeYs-11Qfjo1D8JBLiXV47aQZxUFc8Nc4HZdviyKUSiGYW-XpAw4JvZYyyuZlRNN5S-IByNZu0p5w Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Domain-Id: None Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Domain-Name: None Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Identity-Status: Confirmed Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Is-Admin-Project: True Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Domain-Id: default Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Domain-Name: Default Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Name: admin Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Role: member,admin,reader Jul 20 13:40:03.966423 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Roles: member,admin,reader Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}] Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant: admin Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant-Name: admin Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User: admin Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Domain-Id: default Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Domain-Name: Default Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Id: 96c7a0c328d14b7db355b2f838b651cd Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Name: admin Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: method: > Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: exception: Flavor 42 could not be found. Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: action_args: {'id': '42'} Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:40:03.968052 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:03.968997 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:03.970116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4c24cae0-fa09-4b58-8550-e3c2f149dc69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:40:03.971148 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-4c24cae0-fa09-4b58-8550-e3c2f149dc69 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394781 Jul 20 13:40:03.971148 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 13:40:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:03.977851 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-fe4e9b81-db7d-4809-8258-c6af99235461 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:03.980690 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:04.000929 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-fe4e9b81-db7d-4809-8258-c6af99235461 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027074 Jul 20 13:40:04.001458 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 13:40:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:40:04.011017 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-64065ba9-e39b-407d-b8b4-c4518feac8f3 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:04.032310 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-64065ba9-e39b-407d-b8b4-c4518feac8f3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024849 Jul 20 13:40:04.032832 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 13:40:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:40:04.042527 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-338d9fb4-845e-4616-a197-bd130e96106d admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:04.048568 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.wsgi [None req-338d9fb4-845e-4616-a197-bd130e96106d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-338d9fb4-845e-4616-a197-bd130e96106d admin admin] Request method failure captured: Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Accept: application/json Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Accept-Encoding: gzip, deflate Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Connection: keep-alive Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Content-Length: 0 Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Host: 10.222.0.17 Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Openstack-Api-Version: compute 2.90 Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Openstack-System-Scope: None Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: User-Agent: python-novaclient Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Auth-Token: gAAAAABi2AWzLFNsRK5GQJ6m8-E50OiuR4X-GM80pI9FF8Oj95_I2LecxeYPchoJ_bSiZ_9l3VA7cZvplnp6wUUtNlmZNz2Z5AMHl4vx1LNeYs-11Qfjo1D8JBLiXV47aQZxUFc8Nc4HZdviyKUSiGYW-XpAw4JvZYyyuZlRNN5S-IByNZu0p5w Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Domain-Id: None Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Domain-Name: None Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Identity-Status: Confirmed Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Is-Admin-Project: True Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Domain-Id: default Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Domain-Name: Default Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Name: admin Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Role: member,admin,reader Jul 20 13:40:04.051805 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Roles: member,admin,reader Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}] Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant: admin Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant-Name: admin Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User: admin Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Domain-Id: default Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Domain-Name: Default Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Id: 96c7a0c328d14b7db355b2f838b651cd Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Name: admin Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: method: > Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: exception: Flavor 42 could not be found. Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: action_args: {'id': '42'} Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:40:04.053333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:04.054371 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:04.055719 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-338d9fb4-845e-4616-a197-bd130e96106d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:40:04.057043 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-338d9fb4-845e-4616-a197-bd130e96106d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014801 Jul 20 13:40:04.057043 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 13:40:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:05.036348 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-64065ba9-e39b-407d-b8b4-c4518feac8f3 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:05.037366 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-64065ba9-e39b-407d-b8b4-c4518feac8f3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 20 13:40:05.037764 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:05.561998 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-538b6653-371a-4bc1-8959-9db985765d3f admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:05.568216 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.wsgi [None req-538b6653-371a-4bc1-8959-9db985765d3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-538b6653-371a-4bc1-8959-9db985765d3f admin admin] Request method failure captured: Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Accept: application/json Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Accept-Encoding: gzip, deflate Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Connection: keep-alive Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Content-Length: 0 Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Host: 10.222.0.17 Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Openstack-Api-Version: compute 2.90 Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Openstack-System-Scope: None Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: User-Agent: python-novaclient Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Auth-Token: gAAAAABi2AW0kR8PI3GAu6cEc_QKu6vujtjQVcedZaeSsgjOG5A0scUT2jlIqN3hoH5-kzUsWpYULLJf3yMY7kd9zeV5BDqJsRlgrmkloBAIcUQoknH7ufLeOYBkXSwabqCQTWqE3A2MmQN_5cQtymxNUIKQWDZrm4MPwl3g5SPxHodZMAOsltU Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Domain-Id: None Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Domain-Name: None Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Identity-Status: Confirmed Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Is-Admin-Project: True Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Domain-Id: default Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Domain-Name: Default Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Name: admin Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Role: member,admin,reader Jul 20 13:40:05.569872 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Roles: member,admin,reader Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}] Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant: admin Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant-Name: admin Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User: admin Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Domain-Id: default Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Domain-Name: Default Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Id: 96c7a0c328d14b7db355b2f838b651cd Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Name: admin Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: method: > Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: exception: Flavor 84 could not be found. Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: action_args: {'id': '84'} Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:40:05.572355 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:05.573762 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-538b6653-371a-4bc1-8959-9db985765d3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:40:05.576819 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-538b6653-371a-4bc1-8959-9db985765d3f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397032 Jul 20 13:40:05.576819 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 13:40:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:05.582526 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-6a83383d-1dc9-41e1-8527-fa281cd110a2 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:05.596155 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-6a83383d-1dc9-41e1-8527-fa281cd110a2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017963 Jul 20 13:40:05.596730 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 13:40:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:40:05.606158 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-0d9da65b-ae8d-4376-aaf1-9f3ab59e450a admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:05.620627 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-0d9da65b-ae8d-4376-aaf1-9f3ab59e450a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017895 Jul 20 13:40:05.621169 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 13:40:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:40:05.630996 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-05e0b89b-751a-47e5-80a6-93ed8c74660f admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:05.637266 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.wsgi [None req-05e0b89b-751a-47e5-80a6-93ed8c74660f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-05e0b89b-751a-47e5-80a6-93ed8c74660f admin admin] Request method failure captured: Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Accept: application/json Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Accept-Encoding: gzip, deflate Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Connection: keep-alive Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Content-Length: 0 Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Host: 10.222.0.17 Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Openstack-Api-Version: compute 2.90 Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Openstack-System-Scope: None Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: User-Agent: python-novaclient Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Auth-Token: gAAAAABi2AW0kR8PI3GAu6cEc_QKu6vujtjQVcedZaeSsgjOG5A0scUT2jlIqN3hoH5-kzUsWpYULLJf3yMY7kd9zeV5BDqJsRlgrmkloBAIcUQoknH7ufLeOYBkXSwabqCQTWqE3A2MmQN_5cQtymxNUIKQWDZrm4MPwl3g5SPxHodZMAOsltU Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Domain-Id: None Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Domain-Name: None Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Identity-Status: Confirmed Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Is-Admin-Project: True Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Domain-Id: default Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Domain-Name: Default Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Name: admin Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Role: member,admin,reader Jul 20 13:40:05.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Roles: member,admin,reader Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}] Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant: admin Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant-Name: admin Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User: admin Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Domain-Id: default Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Domain-Name: Default Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Id: 96c7a0c328d14b7db355b2f838b651cd Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Name: admin Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: method: > Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: exception: Flavor 84 could not be found. Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: action_args: {'id': '84'} Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:40:05.640581 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:05.641578 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:05.643061 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-05e0b89b-751a-47e5-80a6-93ed8c74660f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:40:05.644287 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-05e0b89b-751a-47e5-80a6-93ed8c74660f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013266 Jul 20 13:40:05.644287 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jul 20 13:40:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:06.607208 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-0d9da65b-ae8d-4376-aaf1-9f3ab59e450a admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:06.608234 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-0d9da65b-ae8d-4376-aaf1-9f3ab59e450a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 20 13:40:06.608632 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:40:07.123545 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-dab7ce05-a4b7-417c-aa70-a57b4ad66c01 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.wsgi [None req-dab7ce05-a4b7-417c-aa70-a57b4ad66c01 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-dab7ce05-a4b7-417c-aa70-a57b4ad66c01 admin admin] Request method failure captured: Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Accept: application/json Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Accept-Encoding: gzip, deflate Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Connection: keep-alive Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Content-Length: 0 Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Host: 10.222.0.17 Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Openstack-Api-Version: compute 2.90 Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Openstack-System-Scope: None Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: User-Agent: python-novaclient Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Auth-Token: gAAAAABi2AW2GEqvJzOHIiTyco-jnAJ4Bs89wSIxu8z8fd4dPFOkzy8F_0H54H6QceGtKBT_GZ7G6OjF8GaISlcgDWMrDMqhP8phUI1HFLxel91nuJdP-rzWgAEilYp9OVFPc9gre5tugVo8cljDba3IYfxKf0ofIlAtVdO-3uJdhSBZQz303W8 Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Domain-Id: None Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Domain-Name: None Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Identity-Status: Confirmed Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Is-Admin-Project: True Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Domain-Id: default Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Domain-Name: Default Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Project-Name: admin Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Role: member,admin,reader Jul 20 13:40:07.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Roles: member,admin,reader Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}] Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant: admin Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-Tenant-Name: admin Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User: admin Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Domain-Id: default Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Domain-Name: Default Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Id: 96c7a0c328d14b7db355b2f838b651cd Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: X-User-Name: admin Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: method: > Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: exception: Flavor 451 could not be found. Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: action_args: {'id': '451'} Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:40:07.135452 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:07.136351 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.138602 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-dab7ce05-a4b7-417c-aa70-a57b4ad66c01 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:40:07.140894 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-dab7ce05-a4b7-417c-aa70-a57b4ad66c01 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388616 Jul 20 13:40:07.140894 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 13:40:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:07.144084 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-b5226815-63c7-41b7-9bc5-8103ff4bf5bd admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:07.157573 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-b5226815-63c7-41b7-9bc5-8103ff4bf5bd admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017973 Jul 20 13:40:07.158110 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 13:40:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:40:07.167474 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:07.182769 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018833 Jul 20 13:40:07.183298 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jul 20 13:40:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:40:07.192314 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-b6221b08-7f52-4651-9c5d-824c375f0386 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:07.198618 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.wsgi [None req-b6221b08-7f52-4651-9c5d-824c375f0386 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-b6221b08-7f52-4651-9c5d-824c375f0386 admin admin] Request method failure captured: Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Accept: application/json Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Accept-Encoding: gzip, deflate Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Connection: keep-alive Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Content-Length: 0 Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Host: 10.222.0.17 Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Openstack-Api-Version: compute 2.90 Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Openstack-System-Scope: None Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: User-Agent: python-novaclient Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Auth-Token: gAAAAABi2AW2GEqvJzOHIiTyco-jnAJ4Bs89wSIxu8z8fd4dPFOkzy8F_0H54H6QceGtKBT_GZ7G6OjF8GaISlcgDWMrDMqhP8phUI1HFLxel91nuJdP-rzWgAEilYp9OVFPc9gre5tugVo8cljDba3IYfxKf0ofIlAtVdO-3uJdhSBZQz303W8 Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Domain-Id: None Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Domain-Name: None Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Identity-Status: Confirmed Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Is-Admin-Project: True Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Domain-Id: default Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Domain-Name: Default Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Project-Name: admin Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Role: member,admin,reader Jul 20 13:40:07.200171 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Roles: member,admin,reader Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/48523caa484b4c96bfa97c6efa0edb26"}]}] Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant: admin Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant-Id: 48523caa484b4c96bfa97c6efa0edb26 Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-Tenant-Name: admin Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User: admin Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Domain-Id: default Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Domain-Name: Default Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Id: 96c7a0c328d14b7db355b2f838b651cd Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: X-User-Name: admin Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: method: > Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: exception: Flavor 451 could not be found. Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: action_args: {'id': '451'} Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:40:07.201723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:07.202793 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: ERROR nova.api.openstack.wsgi Jul 20 13:40:07.204131 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-b6221b08-7f52-4651-9c5d-824c375f0386 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:40:07.205407 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-b6221b08-7f52-4651-9c5d-824c375f0386 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012694 Jul 20 13:40:07.205407 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 13:40:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:08.158991 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:08.159994 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 20 13:40:08.160458 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:08.678392 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-527b1699-3f06-4a10-976c-cc9d3ead7497 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:40:08.695929 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-527b1699-3f06-4a10-976c-cc9d3ead7497 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.397886 Jul 20 13:40:08.696534 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 13:40:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:40:09.659833 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:09.660882 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 20 13:40:09.661278 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:10.188051 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-b88c6ae4-1184-4526-be85-aeb6e42b389c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:40:10.205523 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-b88c6ae4-1184-4526-be85-aeb6e42b389c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404983 Jul 20 13:40:10.206077 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 13:40:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:40:11.174535 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:11.175535 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 20 13:40:11.175924 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:11.714980 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-c992e719-a74c-4db8-ad9b-59eee170ecf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:40:11.735427 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-c992e719-a74c-4db8-ad9b-59eee170ecf8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.422678 Jul 20 13:40:11.735978 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 13:40:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:40:12.697465 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:12.698460 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jul 20 13:40:12.698859 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:13.222064 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-c381a4e4-c9d6-475f-bcbf-4ecc5c8adea1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:40:13.240615 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-c381a4e4-c9d6-475f-bcbf-4ecc5c8adea1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.405343 Jul 20 13:40:13.241153 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jul 20 13:40:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:40:14.230276 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:14.231306 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 20 13:40:14.231711 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:40:14.761473 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-5096047b-3afa-4430-99c9-d76d98ae6f66 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:40:14.780631 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-5096047b-3afa-4430-99c9-d76d98ae6f66 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409122 Jul 20 13:40:14.781157 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Jul 20 13:40:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:41:06.500180 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:41:06.501222 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-28e89f2f-212d-4181-a5fd-45e38aa9ac5c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 20 13:41:06.501625 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jul 20 13:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:41:06.511997 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:06.893881 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-f444e62f-4e3d-4797-9c8f-7a9cb73ae122 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:41:06.913288 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-f444e62f-4e3d-4797-9c8f-7a9cb73ae122 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405663 Jul 20 13:41:06.913842 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jul 20 13:41:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:41:06.937185 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-1e0e53cf-038e-4e23-9bd3-488d5d0569e1 admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:41:06.940592 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG dbcounter [-] [114984] Writing DB stats nova_api:SELECT=14 {{(pid=114984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:06.946114 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-1e0e53cf-038e-4e23-9bd3-488d5d0569e1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012499 Jul 20 13:41:06.946637 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Jul 20 13:41:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:41:06.958920 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-a7212ad4-0a78-44c1-8f56-df6ce02e8ff9 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:41:06.967012 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-a7212ad4-0a78-44c1-8f56-df6ce02e8ff9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011612 Jul 20 13:41:06.967520 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Jul 20 13:41:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:41:06.978778 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:41:06.986116 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011170 Jul 20 13:41:06.986654 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Jul 20 13:41:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:41:06.997972 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d79f2b19-5010-4a0b-85b9-5178211b8ec8 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:41:07.005566 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d79f2b19-5010-4a0b-85b9-5178211b8ec8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011468 Jul 20 13:41:07.006076 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Jul 20 13:41:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:44:57.095340 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:44:57.096472 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 20 13:44:57.096902 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:44:57.239123 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_api:SELECT=6 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:44:57.398615 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d85e4ed3-892f-4c40-9ac4-88949d68ff85 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:44:57.399774 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:44:57.399774 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: warnings.warn(msg) Jul 20 13:44:57.400985 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d85e4ed3-892f-4c40-9ac4-88949d68ff85 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:44:57.401424 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d85e4ed3-892f-4c40-9ac4-88949d68ff85 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:44:57.402199 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d85e4ed3-892f-4c40-9ac4-88949d68ff85 admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:44:57.402624 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d85e4ed3-892f-4c40-9ac4-88949d68ff85 admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:44:57.436947 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d85e4ed3-892f-4c40-9ac4-88949d68ff85 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.198603 Jul 20 13:44:57.437501 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 13:44:57 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:44:58.258704 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:44:58.259703 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 20 13:44:58.260097 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:44:58.449889 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-745f444d-1a04-466b-af4d-ed42fbfa8019 admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:44:58.451069 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:44:58.451069 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: warnings.warn(msg) Jul 20 13:44:58.452849 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-745f444d-1a04-466b-af4d-ed42fbfa8019 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:44:58.453535 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-745f444d-1a04-466b-af4d-ed42fbfa8019 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:44:58.454333 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-745f444d-1a04-466b-af4d-ed42fbfa8019 admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:44:58.454752 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-745f444d-1a04-466b-af4d-ed42fbfa8019 admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:44:58.478063 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-745f444d-1a04-466b-af4d-ed42fbfa8019 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080419 Jul 20 13:44:58.478634 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 13:44:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:45:09.723221 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:45:09.724239 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jul 20 13:45:09.724636 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:45:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:45:09.866476 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_cell0:SELECT=4 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:45:09.867199 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_cell1:SELECT=4 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:45:09.867888 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG dbcounter [-] [114983] Writing DB stats nova_api:SELECT=8 {{(pid=114983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:45:09.916721 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-08610086-707c-4225-bf3c-b92dba8a81ad admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:45:09.917878 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:45:09.917878 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: warnings.warn(msg) Jul 20 13:45:09.919267 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-08610086-707c-4225-bf3c-b92dba8a81ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:45:09.919704 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-08610086-707c-4225-bf3c-b92dba8a81ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:45:09.921125 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-08610086-707c-4225-bf3c-b92dba8a81ad admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:45:09.921554 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-08610086-707c-4225-bf3c-b92dba8a81ad admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:45:09.946161 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-08610086-707c-4225-bf3c-b92dba8a81ad admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084053 Jul 20 13:45:09.946723 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 13:45:09 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:45:10.773228 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: DEBUG nova.api.openstack.wsgi [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] Calling method '>' {{(pid=114984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:45:10.774234 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: INFO nova.api.openstack.requestlog [None req-4d17ca44-c155-497f-b95b-96f9c1cdc31f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 20 13:45:10.774659 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: [pid: 114984|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jul 20 13:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:45:10.964933 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG nova.api.openstack.wsgi [None req-d0a42322-0acc-456c-8eee-1922be01b53a admin admin] Calling method '>' {{(pid=114983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:45:10.966128 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:45:10.966128 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: warnings.warn(msg) Jul 20 13:45:10.967328 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d0a42322-0acc-456c-8eee-1922be01b53a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:45:10.967765 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d0a42322-0acc-456c-8eee-1922be01b53a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:45:10.968627 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d0a42322-0acc-456c-8eee-1922be01b53a admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:45:10.969055 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: DEBUG oslo_concurrency.lockutils [None req-d0a42322-0acc-456c-8eee-1922be01b53a admin admin] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:45:10.991585 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: INFO nova.api.openstack.requestlog [None req-d0a42322-0acc-456c-8eee-1922be01b53a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078684 Jul 20 13:45:10.992128 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: [pid: 114983|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jul 20 13:45:10 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:46:07.571539 dv-cinder-819149-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 13:46:07.572057 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: Wed Jul 20 13:46:07 2022 - graceful shutdown triggered... Jul 20 13:46:07.572531 dv-cinder-819149-11-iscsi devstack@n-api.service[114983]: Gracefully killing worker 1 (pid: 114983)... Jul 20 13:46:07.572893 dv-cinder-819149-11-iscsi devstack@n-api.service[114984]: Gracefully killing worker 2 (pid: 114984)... Jul 20 13:46:08.572312 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: worker 1 buried after 1 seconds Jul 20 13:46:08.572809 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: worker 2 buried after 1 seconds Jul 20 13:46:08.572809 dv-cinder-819149-11-iscsi devstack@n-api.service[114982]: goodbye to uWSGI. Jul 20 13:46:08.573868 dv-cinder-819149-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 13:46:08.574444 dv-cinder-819149-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 13:46:08.577201 dv-cinder-819149-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 13:46:08.587391 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 13:46:08 2022] *** Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: nodename: dv-cinder-819149-11-iscsi Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: machine: x86_64 Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: clock source: unix Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: pcre jit disabled Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: detected number of CPU cores: 4 Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: current working directory: / Jul 20 13:46:08.589420 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: detected binary path: /usr/bin/uwsgi-core Jul 20 13:46:08.590074 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: your processes number limit is 47680 Jul 20 13:46:08.590074 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: your memory page size is 4096 bytes Jul 20 13:46:08.590074 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: detected max file descriptor number: 2048 Jul 20 13:46:08.590074 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: lock engine: pthread robust mutexes Jul 20 13:46:08.590074 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: thunder lock: enabled Jul 20 13:46:08.590074 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 13:46:08.590074 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 13:46:08.634376 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: Python main interpreter initialized at 0x5557824e69c0 Jul 20 13:46:08.634376 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: python threads support enabled Jul 20 13:46:08.634376 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: your server socket listen backlog is limited to 100 connections Jul 20 13:46:08.634376 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: your mercy for graceful operations on workers is 90 seconds Jul 20 13:46:08.634809 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 13:46:08.634809 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: *** Operational MODE: preforking *** Jul 20 13:46:08.635107 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: *** uWSGI is running in multiple interpreter mode *** Jul 20 13:46:08.635107 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: spawned uWSGI master process (pid: 129526) Jul 20 13:46:08.635308 dv-cinder-819149-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 13:46:08.639121 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: spawned uWSGI worker 1 (pid: 129541, cores: 1) Jul 20 13:46:08.639121 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: spawned uWSGI worker 2 (pid: 129542, cores: 1) Jul 20 13:46:08.639121 dv-cinder-819149-11-iscsi devstack@n-api.service[129526]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 13:46:09.306463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 13:46:09.320737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 13:46:10.503117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:46:10.503117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: from cryptography.utils import int_from_bytes Jul 20 13:46:10.503761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:46:10.503761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: from cryptography.utils import int_from_bytes Jul 20 13:46:10.535733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:46:10.535733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: from cryptography.utils import int_from_bytes Jul 20 13:46:10.536412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:46:10.536412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: from cryptography.utils import int_from_bytes Jul 20 13:46:12.802989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 13:46:12.803562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 13:46:12.803837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 13:46:12.804127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 13:46:12.804407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 13:46:12.804800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.805126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.805444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.805764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.806095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.806404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.806723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.807043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.807371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.807636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.807946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.808292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-11-iscsi {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.808615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.808923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.809234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.809553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.809856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.810178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.810482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.810978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.812243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.812243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.813125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.813659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.813982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.814299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.814636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.814949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.815270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.815584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.815989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-11-iscsi {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.816331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.816664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.816961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.817386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.817699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.817992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.818328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.818636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.818945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.819267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.819583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.819901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.820238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.820543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.820852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.821159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.821607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.821775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.822066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.822352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.822659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.822980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.823302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.823625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.823879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.824129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.824475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.824800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.825106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.825415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.825723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.826027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.826334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.826640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.826947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.827251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.827572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.827887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.828570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.829363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.829757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.830088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.830343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.830651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.830991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.831310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.831620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.831940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.832284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.832594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.832962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.833205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.833524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.833858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.834170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.834409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.834717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.835022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.835339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.835642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.835944 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.836271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.836574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.836880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.837186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.837489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.837793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.838096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.838403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.838704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.839009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.839314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.839633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.839950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.840275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.840582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.840884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.841187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.841382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 13:46:12.841865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.842019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 13:46:12.842169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.842169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.842448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 13:46:12.842599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.842753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 13:46:12.842906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.843063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 13:46:12.843297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.843454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.843687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.843945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.844095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.844348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.844512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.844748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.844951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.845295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.845524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.845524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.845903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.846067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.846223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.846363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.846510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.846652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.846799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.846949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.847089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.847239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.847380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.847518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.847659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-11-iscsi {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.847830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.847989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.848137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.848300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.848461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.849711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.849880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.850023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.850171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.850322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.850463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.850609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.850760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.850913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.851061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.851061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.851335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.851507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.851650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.851797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.851939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.851939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.852242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.852406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.852569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.852826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.852997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.853148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.853325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.853541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.855034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.857024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.857419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.857580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.857726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.857966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.858116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.858116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.858623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-11-iscsi {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.858812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.858970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.859184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.861051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.861330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.861487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.861704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.861850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.862026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.862209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.862375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.862573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.862573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.862573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.862988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.863139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.863290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.863445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.863617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.863768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.863909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.864121 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.864301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.864457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.864599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.864740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.864740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.865091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.865245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.865388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.865540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.865689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.866611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.866798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.866963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.867112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.867260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.867260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.867543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.867686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.867686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.867970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.868120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.868120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.868492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.868642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.868803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.868944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.869607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.869776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.869921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.870068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.870216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.870359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.870506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.870705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.870705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.871022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.871179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.871320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.871460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.871613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.871928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.872075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.872257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.872414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.872563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.872718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.872861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.873002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.873143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.873301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.873527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.873681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.873822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.873970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.873970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.874246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.874246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.874537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.874757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.874904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.875531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.875682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.875849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.876449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.876601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.876743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.876883 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.877024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.877178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.877327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.877476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.877617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.877757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.877904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.878060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.878219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.878367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.878515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.878664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.878818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.878967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.879115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.879351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.879498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.879647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.879798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.879947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.880105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.880336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.880494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.880636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.880789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.880930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.881076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.881218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.881399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.881552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.881552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.881854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.882187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.882346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.882498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.882653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.882845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.883011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.883161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.883349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.883496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.884236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.884408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.884561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.884705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.884852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.884852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.885144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.885719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.885872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.886023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.886637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.886797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.886995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.887155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.887306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.887454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.887605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.887758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.887908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.888049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.888220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.888368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.888527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.888671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.888812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.888952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.889100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.889241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.889482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.889638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.889791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.889932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.890087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.890238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.890389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.890538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.890760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.890918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.891061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.891212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.891354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.891502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.891643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.891795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.891936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.892104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.892506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.892655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.892797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.892938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.893078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.893233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.893385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.893527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.893674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.893824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.893989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.894138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.894286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.894440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.894582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.894728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.894922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.895068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.895209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.895349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.895496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.895645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.895799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.895952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.896093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.896347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.896837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.897002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.897155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:46:12.897306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.897455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.897605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.897746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.897896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.898039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.898190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.898339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.898487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.898628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.898779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.898928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.899071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.899219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.899368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.899600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.899757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.899906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.900056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.900244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.900400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.900550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.900705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.900854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.900996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.901137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.901285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.901435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.901584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.901727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.901867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.902015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.902174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.902739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.902894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.903044 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.903192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.903341 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.903485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.903639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.903782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.904003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.904167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.904352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.904505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.904659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.904899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.905046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.905186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.905186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.905461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.905611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.905759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.905910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.906060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.906201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.907215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.907383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.907535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.907683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.907825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.908010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.908164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.908329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.908473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.908623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.908772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.908912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.909067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.909207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.909358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.909505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.909735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.909882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.910031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.910172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.910311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.910458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.910607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.910756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.910904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.911053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.911201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.911353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.911493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.911643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.911793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.911940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.912081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.912240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.912386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.912538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.912681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.912947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.913175 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.913320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.913485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.913639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.913788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.913932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.914073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.914228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.914383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.914531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.914673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.914814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.914954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.915100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.915264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.915406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.915553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.915705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.915848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.915995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.916144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.916323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.916465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.916615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.916756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.916903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.917456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.917610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.917758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.917899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.918048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.918198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.918348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.918497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.918643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.918789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.918942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.919104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.919258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.919405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.919577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.919745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.919970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.920139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.920312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.920462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.920619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.920774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.920929 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.921086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.921234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.921388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.921542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.921699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.921885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.922072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.922230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.922378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.922525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.922679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.922679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.923077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.923332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.923488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.923488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.923794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.923794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.924111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.924296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.924296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.924595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.924741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.924901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.925059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.925208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.925356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.925517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.925517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.925824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.925972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.926118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.926265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.926421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.926583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.926739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.926894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.927060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.927583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.927749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.927912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.928061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.928284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.928442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.928589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.928735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.928895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.929057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.929206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.929362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.929512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.929686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.930045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.930211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.930369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.930538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.930538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.930839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.930997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.931152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.931300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.931457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.931607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.931761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.931915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.932064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.932317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.932484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.932633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.932633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.932920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.933094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.933352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.933594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.933750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.933906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.934054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.934200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.934361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.934516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.934682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.934832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.934979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.935126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.935282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.935430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.935576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.935729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.935886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.936034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.936213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.936369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.936516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.936685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.936836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.936991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.937139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.937303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.938349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.938507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.938656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.938817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.938967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.939112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.939259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.939405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.939576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.939739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.939888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.940035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.940320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.940474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.940639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.940795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.940943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.941090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.941237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.941383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.941558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.941713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.941861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.942015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.942015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.942313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.942475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.942623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.942769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.942933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.943091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.943248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.943507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.944357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.944531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.944682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.944830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.944991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.945147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.945297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.945452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.945611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.945759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.945914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.946062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.946313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.946482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.946640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.946788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.946948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.947115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.947265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.947412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.947709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.947859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.948021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.948456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.948616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.948765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.948935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.949098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.949254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.949403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.949551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.949705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.949854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.950009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.950157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.950392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.950556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.950706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.950862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.951030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.951186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.951335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.951483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.951629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.951629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.951918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.952067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.952240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.952405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.952554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.952711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.952870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.953025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.953228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.953734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.953985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.954155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.954305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.954452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.954605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.954753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.954900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.955061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.955217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.955383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.955532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.955687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.955843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.956006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.956154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.956388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.956555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.956714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.956871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.957020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.957167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.957313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.957471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.957753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.957924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.958075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.958255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.958668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.958827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.958976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.959138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.959288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.959436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.959583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.959730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.959896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.960096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.960330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.960563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.960730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.960886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.961046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.961880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.962053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.962211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.962374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.962529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.962699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.962847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.963003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.963151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.963307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.963463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.963611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.963776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.964148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.964339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.964491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.964637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.964791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.964950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.965098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.965259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.965415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.965565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.965718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.965872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.966020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.966183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.966464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.966464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.966770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.966937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.967085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.967247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.967396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.967551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.967868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.968027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.968291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.968450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.969430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.969599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.969749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.969897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.970072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.970222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.970222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.970521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.970808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.970974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.971123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.971278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.971466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.971634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.971785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.971940 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.972090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.972287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.972287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.972590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.972739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.972886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.973067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.973229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.973378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.973541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.973690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.973846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.974008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.974381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.974540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.974698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.974854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.975010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.975159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.975314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.975314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.976946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977203 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.977725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.978939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.979901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.980945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.981973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.982990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.983992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.984077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.984077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.984246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.984437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.985981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.986897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.987890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.988974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.989991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.990951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.991957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.992960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.993970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.994943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.995969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.996995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.997967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.998994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999175 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:12.999902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.000636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.001913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.002145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.002227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.002477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.002574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.002827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.002934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.003142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.003237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.003463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.003543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.003782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.003912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.004100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.004258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.004442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.004567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.004757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.004897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.005075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.005224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.005524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.005620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.005709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.006952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.007093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.007289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.007391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.007611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.007701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.007927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.008058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.008413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.008544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.008739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.008849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.009107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.009382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.009487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.009744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.009908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.010091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.010268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.010410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.010597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.010764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.010924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.011085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.011226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.011391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.011544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.011684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.011830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.012093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.012258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.012364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.012460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.012675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.012815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.013003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.013095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.013314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.013450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.013726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.013842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.013937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.014030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.014241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.014344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.014550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.014666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.014855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.014982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.015180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.015487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.015622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.015839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.015941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.016156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.016325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.016506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.016612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.016834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.016927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.017143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.017236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.017449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.017548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.017773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.017870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.018075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.018167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.018395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.018533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.018685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.018790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.018995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.019098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.019296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.019388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.019600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.019746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.019970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.020074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.020226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.020313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.020536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.020641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.020848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.020945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.021151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.021241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.021476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.021577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.021781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.021880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.022088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.022178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.022391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.022490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.022705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.022803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.023010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.023101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.023314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.023413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.023620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.023711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.023922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.024012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.024252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.024346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.024559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.024648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.024864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.024955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.025167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.025267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.025480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.025571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.025783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.025913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.026090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.026183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.026406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.026497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.026712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.026810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.027021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.027113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.027325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.027423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.027640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.027738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.027950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.028042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.028294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.028402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.028612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.028724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.028921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.029033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.029248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.029349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.029563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.029683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.029892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.030100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.030248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.030438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.030555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.030761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.030866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.031094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.031199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.032983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.033187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.033297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.033499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.033601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.033813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.033932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.034125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.034376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.034487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.034709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.034812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.035030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.035133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.035341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.035450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.035653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.035765 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.035964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.036081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.036301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.036405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.036619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.036742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.036936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.037037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.037253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.037356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.037568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.037677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.037899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.038002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.038226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.038321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.038544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.038659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.038864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.038973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.039251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.039361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.039493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.039583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.039793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.039901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.040103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.040243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.040437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.040598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.040756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.040924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.042936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.043976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.044071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.044323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.044525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.044687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.044849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.045011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.045170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.045471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.045619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.045718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.045823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.045908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.046205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.046329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.046527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.046641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.046836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.047609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.047756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.047950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.048054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.048281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.048469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.049351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.049553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.049643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.049751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.049847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.049934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.050823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.051032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.051140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.051340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.051437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.051642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.051748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.051947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.052040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.052273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.052371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.052579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.052681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.052883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.052976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.053188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.053422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.053530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.053784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.053878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.054089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.054181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.054395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.054536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.054700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.054794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.055001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.055101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.055336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.055495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.055664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.055758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.055976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.056069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.056323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.056443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.056632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.056723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.056943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.057036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.057252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.057353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.057561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.057654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.057877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.058017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.058191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.058320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.058497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.058623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.058811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.058912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.059118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.059212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.059433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.059546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.059743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.059845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.060052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.060151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.060387 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.060482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.060701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.060807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.061007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.061154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.061317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.061453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.061627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.061735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.061936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.062038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.062255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.062347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.062585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.062695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.062903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.063062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.063210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.063305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.063530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.063630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.063838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.063933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.064149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.064272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.064484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.064623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.064796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.064897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.065108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.065200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.065426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.065519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.065739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.065832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.066053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.066154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.066431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.066537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.066686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.066787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.067004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.067107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.067328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.067420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.067640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.067733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.067968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.068185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.068337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.068543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.068637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.068871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.068963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.069209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.069303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.069548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.069653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.069859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.069967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.070170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.070263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.070479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.070580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.070717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 13:46:13.070821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.071110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.071427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.071742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.072060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.072527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.072845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.073166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.073481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.073797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.074112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.074429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.074747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.075060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.075382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.075739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.076065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.076412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.076739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.077059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.077375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.077689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.078003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.078876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.079194 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.079650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.079889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.080247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.080666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.080986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.081397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.081719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.082008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.082283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.082611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.082984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.083251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.083578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.083914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.084290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.084627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.084958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.085266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.085574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.085883 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.086197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.086520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.086890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.087132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.087440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.087763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.088056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.088463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.088703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.089013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.089645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.089645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.090046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.090214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.090520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.090999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.091163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.091558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.091740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.092050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.092654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.092815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.092983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.093335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.093669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.094426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.094426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.094753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.095112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.095492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.095712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.096038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.096389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.096708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.097082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.097359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.097676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.097992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.098307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.098626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.098944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.099286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.099618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.099984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.100280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.100603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.100931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.101255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.101570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.101904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.102219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.102534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.102874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.103165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.103481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.103800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.104115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.104530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.104850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.105178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.105503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.105984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.106158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.106875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.106875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.107124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.107438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.107792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.108422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.108948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.109272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.110259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:46:13.113214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 13:46:13.229079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO dbcounter [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Registered counter for database nova_api Jul 20 13:46:13.250315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_db.sqlalchemy.engines [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.257352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writer thread running {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.266222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO dbcounter [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Registered counter for database nova_api Jul 20 13:46:13.286905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_db.sqlalchemy.engines [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.293619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writer thread running {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.315689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.context [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6fdd732e-d85d-4c48-8292-9a17203a2e04(cell1) {{(pid=129541) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 13:46:13.319814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:46:13.321435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:46:13.322291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:46:13.324317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:46:13.326316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO dbcounter [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Registered counter for database nova_cell0 Jul 20 13:46:13.330917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO dbcounter [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Registered counter for database nova_cell1 Jul 20 13:46:13.338254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_db.sqlalchemy.engines [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.341011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_db.sqlalchemy.engines [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.347166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writer thread running {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.351847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.context [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6fdd732e-d85d-4c48-8292-9a17203a2e04(cell1) {{(pid=129542) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 13:46:13.353197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writer thread running {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.356052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:46:13.357691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:46:13.358529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:46:13.360677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:46:13.362738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO dbcounter [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Registered counter for database nova_cell0 Jul 20 13:46:13.366912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO dbcounter [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Registered counter for database nova_cell1 Jul 20 13:46:13.374214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_db.sqlalchemy.engines [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.377199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_db.sqlalchemy.engines [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.381928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writer thread running {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.384568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writer thread running {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.499222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO dbcounter [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Registered counter for database nova_cell0 Jul 20 13:46:13.505788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_db.sqlalchemy.engines [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.510148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writer thread running {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.533850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO dbcounter [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Registered counter for database nova_cell0 Jul 20 13:46:13.540419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_db.sqlalchemy.engines [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:46:13.544790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writer thread running {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:46:13.834475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: WARNING keystonemiddleware.auth_token [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:46:13.842036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: WARNING keystonemiddleware.auth_token [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:46:13.871305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: WARNING keystonemiddleware.auth_token [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:46:13.879317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: WARNING keystonemiddleware.auth_token [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:46:14.183631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: WARNING keystonemiddleware.auth_token [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:46:14.189756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: WARNING keystonemiddleware.auth_token [None req-71f8a2b4-1976-4d79-8e5b-70d4a2c34ef9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:46:14.195888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557824e69c0 pid: 129541 (default app) Jul 20 13:46:14.224479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: WARNING keystonemiddleware.auth_token [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 13:46:14.230586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: WARNING keystonemiddleware.auth_token [None req-902239fd-9e18-43ec-928f-8a0d96a16f4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 13:46:14.236896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557824e69c0 pid: 129542 (default app) Jul 20 13:46:55.417926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=3 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.419073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=3 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.419819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=3 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.421292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=3 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.570444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.573173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.575854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.576858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:57.298976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ca665f86-4196-488c-b917-3344410f7e89 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Action: 'create', calling method: .version_select at 0x7fa40f1d2c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-163383668"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:46:57.434893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1dd9d9b1-b113-4b2e-b1d4-bc1e962aaec5 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Action: 'create', calling method: .version_select at 0x7fa40f241ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1405965513", "metadata": {"Type": "work"}}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:46:59.330647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ca665f86-4196-488c-b917-3344410f7e89 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.923497 Jul 20 13:46:59.331732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1154 bytes} [Wed Jul 20 13:46:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3927 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 13:46:59.344925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-45aca80d-5a36-463c-958d-4488bf13b4c3 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f09da60>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:00.571077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-45aca80d-5a36-463c-958d-4488bf13b4c3 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 200 len: 345 microversion: 2.1 time: 1.231378 Jul 20 13:47:00.571897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 2/2] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:46:59 2022] GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 345 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:00.585370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2b7d4d00-2def-4cc7-98e9-84d18be3674d tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Action: 'create', calling method: .version_select at 0x7fa40f09dd30>, body: {"snapshot": {"volume_id": "fbfb2257-cb03-4148-80e0-b8ce9d703890", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2001383107"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:00.861064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1dd9d9b1-b113-4b2e-b1d4-bc1e962aaec5 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.301629 Jul 20 13:47:00.881930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 13:46:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5329 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 13:47:00.903446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6242cedb-bab0-4785-9613-63d5b1c1bc34 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Calling method '.version_select at 0x7fa40f09daf0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:01.745671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2b7d4d00-2def-4cc7-98e9-84d18be3674d tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.164233 Jul 20 13:47:01.746899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 3/4] 10.222.0.17 () {60 vars in 1161 bytes} [Wed Jul 20 13:47:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:01.762778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f952f76a-82f1-4010-9eda-714ba41bbac6 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0b3700>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:01.861394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6242cedb-bab0-4785-9613-63d5b1c1bc34 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad" status: 200 len: 354 microversion: 2.1 time: 0.977431 Jul 20 13:47:01.861394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 2/5] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:00 2022] GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad => generated 354 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:01.872819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-82d70668-3cc1-4508-95c2-91d6232fa136 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Calling method '.version_select at 0x7fa40f09dc10>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:02.064338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-82d70668-3cc1-4508-95c2-91d6232fa136 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad" status: 200 len: 354 microversion: 2.1 time: 0.195599 Jul 20 13:47:02.065234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:01 2022] GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:02.083188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f4336e0d-17b2-429e-add6-b5c293c4de8d tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Calling method '.version_select at 0x7fa40f0b9280>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:02.095098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f952f76a-82f1-4010-9eda-714ba41bbac6 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 200 len: 287 microversion: 2.1 time: 0.342089 Jul 20 13:47:02.095811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 13:47:01 2022] GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 287 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:47:02.105976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-908b2058-d318-4efe-8443-7296e90c0be4 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0b3dc0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:02.226794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-908b2058-d318-4efe-8443-7296e90c0be4 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.124620 Jul 20 13:47:02.227683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jul 20 13:47:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:47:02.238826 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7a0928ac-4b7b-4d7e-943b-cdea0dec9449 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0b33a0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:02.365975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7a0928ac-4b7b-4d7e-943b-cdea0dec9449 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 200 len: 287 microversion: 2.1 time: 0.131406 Jul 20 13:47:02.368506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 6/9] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 13:47:02 2022] GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:47:02.560588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f4336e0d-17b2-429e-add6-b5c293c4de8d tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad" status: 202 len: 0 microversion: 2.1 time: 0.481086 Jul 20 13:47:02.561207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 4/10] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 13:47:02 2022] DELETE /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 13:47:02.571326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e79f1b8c-e0c0-486b-8664-218700557e33 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Calling method '.version_select at 0x7fa40f0b3430>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:02.741181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e79f1b8c-e0c0-486b-8664-218700557e33 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad" status: 200 len: 353 microversion: 2.1 time: 0.173508 Jul 20 13:47:02.743774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 7/11] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:02 2022] GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:03.385432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3c546919-f9b9-45c4-ae97-1b7d1a366a9d tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0b9940>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:03.437418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3c546919-f9b9-45c4-ae97-1b7d1a366a9d tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 200 len: 287 microversion: 2.1 time: 0.060352 Jul 20 13:47:03.442017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 5/12] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 13:47:03 2022] GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:03.755952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c5da6b26-6599-4d46-ac8b-4ca5e1292ae1 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Calling method '.version_select at 0x7fa40f09d8b0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:03.843393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c5da6b26-6599-4d46-ac8b-4ca5e1292ae1 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad" status: 200 len: 353 microversion: 2.1 time: 0.092453 Jul 20 13:47:03.844236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 8/13] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:03 2022] GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:04.451611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-35dc603b-a819-42d7-a820-41f7fccf4941 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f09da60>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:04.531308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-35dc603b-a819-42d7-a820-41f7fccf4941 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 200 len: 287 microversion: 2.1 time: 0.085381 Jul 20 13:47:04.536875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 6/14] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 13:47:04 2022] GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:04.856778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-df20d6e4-0cfb-48ce-9902-f5733f59db19 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Calling method '.version_select at 0x7fa40f09dc10>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:04.989313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-df20d6e4-0cfb-48ce-9902-f5733f59db19 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad" status: 200 len: 353 microversion: 2.1 time: 0.137179 Jul 20 13:47:04.994284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 9/15] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:04 2022] GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:05.544845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-43025c67-f344-4a6c-bc8c-bb9f326004da tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0b3280>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:05.603847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-43b045e5-b4a4-42ac-9139-20526e60e58b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'create', calling method: .version_select at 0x7fa40f0b9ca0>, body: {"keypair": {"name": "tempest-keypair-830455995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATQoeCfmeppYedvume6GTnNhQ3KAi2qfzRijkknA/tKeRBJs+1ARZpfTpDrIVo4xfhIOarjYQLMK+re7vtIg4NiNMazf8C2bViXZ3GOWTj/YSMdpwSbQAPnYACdh9Be2Q=="}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:05.621760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-43025c67-f344-4a6c-bc8c-bb9f326004da tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 200 len: 288 microversion: 2.1 time: 0.080905 Jul 20 13:47:05.637376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 10/16] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 13:47:05 2022] GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:05.642604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-711dcd9e-3588-472c-99cf-de5a603b8109 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0b3820>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:05.717157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-43b045e5-b4a4-42ac-9139-20526e60e58b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:47:05.728035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-43b045e5-b4a4-42ac-9139-20526e60e58b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for user b55c81544d4342fb89dd8dbce3400fe4 and project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:47:05.779230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-711dcd9e-3588-472c-99cf-de5a603b8109 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 202 len: 0 microversion: 2.1 time: 0.140562 Jul 20 13:47:05.780695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 11/17] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jul 20 13:47:05 2022] DELETE /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:47:05.788576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-873abbc5-243c-4167-8ac2-d26030040d84 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0491f0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:05.847170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-43b045e5-b4a4-42ac-9139-20526e60e58b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.379632 Jul 20 13:47:05.849713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 7/18] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 13:47:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:05.862026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-873abbc5-243c-4167-8ac2-d26030040d84 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 200 len: 287 microversion: 2.1 time: 0.077141 Jul 20 13:47:05.863371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 12/19] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 13:47:05 2022] GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:06.012478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6b87fd3d-331b-4e83-b30d-ab93375e42c1 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Calling method '.version_select at 0x7fa40f0109d0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:06.086763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-6b87fd3d-331b-4e83-b30d-ab93375e42c1 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] HTTP exception thrown: Volume 2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad could not be found. Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6b87fd3d-331b-4e83-b30d-ab93375e42c1 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Request method failure captured: Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad HTTP/1.1 Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdPZaNjAWI0Sl_Y23e-gso-CDEJVgPVjFvx9LR9JIK5fUT24bwOGISQSzMSRak-n6ydrtccalxdBH5IgmTnLtQhXSfXhEJJqYXIXJ0crNMDokw7pZvhad2-3Rr_MQeB3rNTSDyz2TyFcyQ2nURcdisoXIMrWu5ezgNrSpyHYjNJE00 Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: ba279ef34ec4419e9438f5e6811c3ce1 Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-VolumesGetTestJSON-360216277 Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:47:06.101718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ba279ef34ec4419e9438f5e6811c3ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ba279ef34ec4419e9438f5e6811c3ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ba279ef34ec4419e9438f5e6811c3ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ba279ef34ec4419e9438f5e6811c3ce1"}]}] Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-VolumesGetTestJSON-360216277 Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: ba279ef34ec4419e9438f5e6811c3ce1 Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-VolumesGetTestJSON-360216277 Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-VolumesGetTestJSON-360216277-project Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: baa6d72bd62f403095f8c6ba1c93f023 Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-VolumesGetTestJSON-360216277-project Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Volume 2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad could not be found. Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad'} Jul 20 13:47:06.102903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad could not be found. (HTTP 404) (Request-ID: req-8f41782f-11a5-4de9-8a60-56281ba37d7b) Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:06.103555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:06.104524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad could not be found. Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 13:47:06.105514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad could not be found. Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad could not be found. Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6b87fd3d-331b-4e83-b30d-ab93375e42c1 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] Returning 404 to user: Volume 2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6b87fd3d-331b-4e83-b30d-ab93375e42c1 tempest-VolumesGetTestJSON-360216277 tempest-VolumesGetTestJSON-360216277-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad" status: 404 len: 109 microversion: 2.1 time: 0.107238 Jul 20 13:47:06.106417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 8/20] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:05 2022] GET /compute/v2.1/os-volumes/2dac9a8a-1b97-4cf9-baf9-aa9b1a5908ad => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:47:06.875278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ffbe66e1-9996-4d82-b2a9-fcc4a8f370d3 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f0b33a0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:06.939120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-ffbe66e1-9996-4d82-b2a9-fcc4a8f370d3 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] HTTP exception thrown: Snapshot 7a1f1a61-bbba-4ee5-aa0b-363669724428 could not be found. Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ffbe66e1-9996-4d82-b2a9-fcc4a8f370d3 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Request method failure captured: Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 HTTP/1.1 Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdPGKN84mNGu0nnd3Ftb72EMjXAEMM1tqGjLoQfoghBg_O_kO0uFjOd5W3h9fyyLj44JSi3Yij2PBCycvRP6tdqrCcITFUvZn838pqxbHa4knyZSo-y1hjuIYb8G-AMvKJCo2AQnPOXz7VuYQF9tk8sKMWu-OF1frqSrsUpVVwhmYs Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:47:06.943234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}] Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: f23c790443054398a773f19508158509 Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Snapshot 7a1f1a61-bbba-4ee5-aa0b-363669724428 could not be found. Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '7a1f1a61-bbba-4ee5-aa0b-363669724428'} Jul 20 13:47:06.944569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7a1f1a61-bbba-4ee5-aa0b-363669724428 could not be found. (HTTP 404) (Request-ID: req-bbc160ff-2383-44be-bbf4-620adad443b9) Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.945396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:06.946413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7a1f1a61-bbba-4ee5-aa0b-363669724428 could not be found. Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 13:47:06.947328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7a1f1a61-bbba-4ee5-aa0b-363669724428 could not be found. Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7a1f1a61-bbba-4ee5-aa0b-363669724428 could not be found. Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ffbe66e1-9996-4d82-b2a9-fcc4a8f370d3 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Returning 404 to user: Snapshot 7a1f1a61-bbba-4ee5-aa0b-363669724428 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:47:06.948357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ffbe66e1-9996-4d82-b2a9-fcc4a8f370d3 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428" status: 404 len: 111 microversion: 2.1 time: 0.073912 Jul 20 13:47:06.948996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 13/21] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jul 20 13:47:06 2022] GET /compute/v2.1/os-snapshots/7a1f1a61-bbba-4ee5-aa0b-363669724428 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:47:06.955301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fa45bf10-752c-418b-a098-ca102ce08f76 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f13e8b0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:07.082717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fa45bf10-752c-418b-a098-ca102ce08f76 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 202 len: 0 microversion: 2.1 time: 0.132855 Jul 20 13:47:07.083550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 9/22] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 13:47:06 2022] DELETE /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:47:07.093081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e5bafb2d-b7d8-4b3b-b6ac-8c1c85dfd2da tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40fa34040>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:07.164464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e5bafb2d-b7d8-4b3b-b6ac-8c1c85dfd2da tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 200 len: 344 microversion: 2.1 time: 0.075932 Jul 20 13:47:07.166149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 14/23] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:07 2022] GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:08.180153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0e946c20-a242-4619-ae2f-facf6918ddd0 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f010af0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:08.276795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0e946c20-a242-4619-ae2f-facf6918ddd0 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 200 len: 344 microversion: 2.1 time: 0.101799 Jul 20 13:47:08.277560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 10/24] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:08 2022] GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:09.293387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e68a0869-8b2d-44e3-976c-77739864d8fd tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f09da60>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:09.402971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e68a0869-8b2d-44e3-976c-77739864d8fd tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 200 len: 344 microversion: 2.1 time: 0.113697 Jul 20 13:47:09.403542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 15/25] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:09 2022] GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 344 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:10.416621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e09026eb-49f0-4811-bfe6-7783acae2f16 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40e802af0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:10.478771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-e09026eb-49f0-4811-bfe6-7783acae2f16 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] HTTP exception thrown: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e09026eb-49f0-4811-bfe6-7783acae2f16 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Request method failure captured: Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 HTTP/1.1 Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdPGKN84mNGu0nnd3Ftb72EMjXAEMM1tqGjLoQfoghBg_O_kO0uFjOd5W3h9fyyLj44JSi3Yij2PBCycvRP6tdqrCcITFUvZn838pqxbHa4knyZSo-y1hjuIYb8G-AMvKJCo2AQnPOXz7VuYQF9tk8sKMWu-OF1frqSrsUpVVwhmYs Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:47:10.490539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}] Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: f23c790443054398a773f19508158509 Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': 'fbfb2257-cb03-4148-80e0-b8ce9d703890'} Jul 20 13:47:10.491577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. (HTTP 404) (Request-ID: req-8a916fb9-862b-417d-84f6-09b6ba9a2d95) Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.492223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:10.493113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 13:47:10.493971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.494905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.496571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e09026eb-49f0-4811-bfe6-7783acae2f16 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Returning 404 to user: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:47:10.498793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e09026eb-49f0-4811-bfe6-7783acae2f16 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 404 len: 109 microversion: 2.1 time: 0.085910 Jul 20 13:47:10.503617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 11/26] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:10 2022] GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:47:10.512610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6992f7c3-c6a0-4572-bbd3-1427c4987057 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40f049a60>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:10.597931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-6992f7c3-c6a0-4572-bbd3-1427c4987057 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] HTTP exception thrown: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6992f7c3-c6a0-4572-bbd3-1427c4987057 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Request method failure captured: Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 HTTP/1.1 Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdPGKN84mNGu0nnd3Ftb72EMjXAEMM1tqGjLoQfoghBg_O_kO0uFjOd5W3h9fyyLj44JSi3Yij2PBCycvRP6tdqrCcITFUvZn838pqxbHa4knyZSo-y1hjuIYb8G-AMvKJCo2AQnPOXz7VuYQF9tk8sKMWu-OF1frqSrsUpVVwhmYs Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:47:10.600151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}] Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: f23c790443054398a773f19508158509 Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': 'fbfb2257-cb03-4148-80e0-b8ce9d703890'} Jul 20 13:47:10.601204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. (HTTP 404) (Request-ID: req-003547ad-30e3-44eb-8bee-bba553f60a55) Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.601817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 13:47:10.602730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 13:47:10.603602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6992f7c3-c6a0-4572-bbd3-1427c4987057 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Returning 404 to user: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6992f7c3-c6a0-4572-bbd3-1427c4987057 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 404 len: 109 microversion: 2.1 time: 0.092763 Jul 20 13:47:10.604504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 16/27] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 13:47:10 2022] DELETE /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:47:10.611144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4b9b4b73-a544-4828-94f9-c278a212a691 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Calling method '.version_select at 0x7fa40e802c10>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:10.694791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-4b9b4b73-a544-4828-94f9-c278a212a691 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] HTTP exception thrown: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4b9b4b73-a544-4828-94f9-c278a212a691 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Request method failure captured: Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 HTTP/1.1 Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdPGKN84mNGu0nnd3Ftb72EMjXAEMM1tqGjLoQfoghBg_O_kO0uFjOd5W3h9fyyLj44JSi3Yij2PBCycvRP6tdqrCcITFUvZn838pqxbHa4knyZSo-y1hjuIYb8G-AMvKJCo2AQnPOXz7VuYQF9tk8sKMWu-OF1frqSrsUpVVwhmYs Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:47:10.696729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d7333e4bd914d24bf1a05e10d7bd7a1"}]}] Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 4d7333e4bd914d24bf1a05e10d7bd7a1 Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197968624 Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: f23c790443054398a773f19508158509 Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197968624-project Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': 'fbfb2257-cb03-4148-80e0-b8ce9d703890'} Jul 20 13:47:10.697786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. (HTTP 404) (Request-ID: req-e8f6fad3-9047-44d5-8650-769fcef6823d) Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.698414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:47:10.699340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 13:47:10.700336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4b9b4b73-a544-4828-94f9-c278a212a691 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] Returning 404 to user: Volume fbfb2257-cb03-4148-80e0-b8ce9d703890 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4b9b4b73-a544-4828-94f9-c278a212a691 tempest-VolumesSnapshotsTestJSON-1197968624 tempest-VolumesSnapshotsTestJSON-1197968624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890" status: 404 len: 109 microversion: 2.1 time: 0.091789 Jul 20 13:47:10.701297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 12/28] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:10 2022] GET /compute/v2.1/os-volumes/fbfb2257-cb03-4148-80e0-b8ce9d703890 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:47:11.770706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1185024289", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:12.067087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] validate_networks() for [('71fe8e05-3455-4a93-b609-45dfcc2a72ff', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:47:12.144161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1287830268", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd6608b4-5bdb-4caf-9118-f60455994f25"}], "security_groups": [{"name": "tempest-securitygroup--1321070867"}], "key_name": "tempest-keypair-830455995", "user_data": "}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:12.735730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] validate_networks() for [('cd6608b4-5bdb-4caf-9118-f60455994f25', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:47:13.462625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:47:13.463141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:47:13.463554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:47:13.464216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:47:13.464748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:47:13.526895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:13.527705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:13.530670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:13.531290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:13.576266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:47:13.584213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for user 7c1d0edb03914ac69ebdb833ee1c2d75 and project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:47:13.604472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:47:13.624064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:47:13.735718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8e8788ad-dee4-47c9-8a2c-7fd74ddcc804 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.745388 Jul 20 13:47:13.736845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 17/29] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:47:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:47:14.153426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c4c58e95-97d9-4e60-80a8-c73133ab5fb7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'create', calling method: .version_select at 0x7fa40e71e550>, body: {"keypair": {"name": "tempest-keypair-814395199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGt1ux4TlsYOKet0/2BW6YOdUoiUEqbfsrFwnPLCZcZ0rkgtOlolRSbZ48fmuzJFhA04krFOGDhItfPGu1QEU/OZ6fbpdA3AAPhVTR9tznSOwCHfD3qXq9iJBFGHnRCg1g=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:14.192129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-c4c58e95-97d9-4e60-80a8-c73133ab5fb7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for project cc6c042204f0471ba5c2f8a67604a802. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:47:14.201846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-c4c58e95-97d9-4e60-80a8-c73133ab5fb7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for user f9cb52fe271348c1bc0ffda92063bf59 and project cc6c042204f0471ba5c2f8a67604a802. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:47:14.281729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c4c58e95-97d9-4e60-80a8-c73133ab5fb7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.543208 Jul 20 13:47:14.283088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 18/30] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 13:47:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 546 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 13:47:14.288537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2b8c4569-7a5b-4e37-bb31-24cd84a92b4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:14.289571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2b8c4569-7a5b-4e37-bb31-24cd84a92b4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:14.431864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2b8c4569-7a5b-4e37-bb31-24cd84a92b4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:14.454697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2b8c4569-7a5b-4e37-bb31-24cd84a92b4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1222 microversion: 2.1 time: 0.169360 Jul 20 13:47:14.457202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 19/31] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:14 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:15.121768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-57159510", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "networks": [{"uuid": "bdf2690a-d4b5-4f89-89c5-ff9dd8d1e33f"}]}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:15.278693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] validate_networks() for [('bdf2690a-d4b5-4f89-89c5-ff9dd8d1e33f', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:47:15.550614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:47:15.551191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:47:15.551618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:47:15.552089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:47:15.552542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:47:15.594828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:15.594828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:15.594828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:15.595693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:15.679059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:47:15.686505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for user b55c81544d4342fb89dd8dbce3400fe4 and project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:47:15.722797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:47:15.729963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:47:15.966172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4f12c656-c4ca-4356-bad0-daf933fc039b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.830934 Jul 20 13:47:15.969994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 13/32] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:47:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:47:15.988576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-949242624", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:16.142636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] validate_networks() for [('71fe8e05-3455-4a93-b609-45dfcc2a72ff', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:47:17.612294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:47:17.613152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:47:17.613867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:47:17.615523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:47:17.616162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:47:17.650995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:17.654761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:17.656735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:17.657438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:17.751102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Getting quotas for project f4d1a070c0624b1e9e0b12d5eb0cb0b5. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:47:17.770675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Getting quotas for user 419fced725134a31bee9907051f2621b and project f4d1a070c0624b1e9e0b12d5eb0cb0b5. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:47:17.804999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:47:17.807708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:47:17.847263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:47:17.847808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:47:17.848167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:47:17.848642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:47:17.849064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:47:17.881462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:17.882053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:17.882894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:17.910185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:17.916766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae11b344-5c2b-4bbd-b8ce-97d0f5a5a240 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.246712 Jul 20 13:47:17.919457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 20/33] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 13:47:17.928183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:17.929192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:17.970308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:17.971015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:17.972969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:17.974045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:18.035223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:47:18.064564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for user 7c1d0edb03914ac69ebdb833ee1c2d75 and project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:47:18.156827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:47:18.158999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:47:18.378124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-26e7f98a-500c-4aa7-97d3-d5ef86e5e4c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.401317 Jul 20 13:47:18.380450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 14/34] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:47:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:47:18.397229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-302cd3d4-42cb-46a9-8f77-2b52a8aacd71 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:18.399271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-302cd3d4-42cb-46a9-8f77-2b52a8aacd71 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:18.589036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:18.615337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e6a1eaa8-cdcf-4f65-b388-58d5ce066f4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1241 microversion: 2.1 time: 0.693594 Jul 20 13:47:18.622658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 21/35] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1241 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:18.647456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b9cbb669-96a4-43eb-8b54-545dbd28b3ce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:18.648435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b9cbb669-96a4-43eb-8b54-545dbd28b3ce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:18.815404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-302cd3d4-42cb-46a9-8f77-2b52a8aacd71 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:18.858594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-302cd3d4-42cb-46a9-8f77-2b52a8aacd71 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1213 microversion: 2.1 time: 0.473738 Jul 20 13:47:18.861688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 15/36] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:18 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1213 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:18.973980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b9cbb669-96a4-43eb-8b54-545dbd28b3ce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:18.985634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b9cbb669-96a4-43eb-8b54-545dbd28b3ce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1221 microversion: 2.1 time: 0.360465 Jul 20 13:47:18.996856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 22/37] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:18 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1221 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:19.622214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-331615549", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f19ce632-ef4e-4ff0-a5d7-ee203095cf35"}], "security_groups": [{"name": "tempest-securitygroup--1739307481"}], "key_name": "tempest-keypair-814395199", "user_data": "}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:19.633212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:19.634023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:19.651079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:19.652642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:19.655891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:19.656718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:19.809631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] validate_networks() for [('f19ce632-ef4e-4ff0-a5d7-ee203095cf35', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:47:19.813471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:19.825251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1fddc8eb-41af-447d-bcc5-5b633c8b8fee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1241 microversion: 2.1 time: 0.192094 Jul 20 13:47:19.835360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 23/38] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1241 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:19.876509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:19.877268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:19.900878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:19.901721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:19.902642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:19.903211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:20.038422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:20.057648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b146186d-40a9-4ff2-a3e6-5f4e49c23bf6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1217 microversion: 2.1 time: 0.185212 Jul 20 13:47:20.059197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 24/39] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:19 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:20.065888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:20.067258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:20.077643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:20.078601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:20.080674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:20.082266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:20.261494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:20.279128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-80e8c092-d119-40c8-bb29-7dd86522642b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1225 microversion: 2.1 time: 0.218443 Jul 20 13:47:20.286809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 25/40] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:20 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1225 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:20.685829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:47:20.686894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:47:20.687569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:47:20.688155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:47:20.691491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:47:20.704153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:20.704809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:20.705821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:20.706613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:20.729416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for project cc6c042204f0471ba5c2f8a67604a802. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:47:20.734514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for user f9cb52fe271348c1bc0ffda92063bf59 and project cc6c042204f0471ba5c2f8a67604a802. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:47:20.747880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:47:20.750796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:47:20.833118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-14eabf71-2a1d-4793-ad91-219b740d60b9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.216439 Jul 20 13:47:20.836092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 16/41] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 13:47:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 13:47:20.850386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:20.850984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:20.851898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5a5508e9-6450-4075-8ef8-ce80c3a005e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:20.852919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5a5508e9-6450-4075-8ef8-ce80c3a005e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:20.860706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:20.864105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:20.864917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:20.868256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:20.930598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5a5508e9-6450-4075-8ef8-ce80c3a005e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:20.943703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5a5508e9-6450-4075-8ef8-ce80c3a005e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:20.946394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5a5508e9-6450-4075-8ef8-ce80c3a005e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:20.947855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5a5508e9-6450-4075-8ef8-ce80c3a005e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1280 microversion: 2.20 time: 0.102089 Jul 20 13:47:20.948971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 17/42] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1280 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:21.078724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:21.079360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:21.093484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:21.106007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:21.110203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:21.111421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:21.427579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:21.453408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d2774a76-b7e0-4c11-9a28-cfd2c60aea59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1289 microversion: 2.1 time: 0.606468 Jul 20 13:47:21.455833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 26/43] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:20 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1289 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:21.469507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-53c48495-ec8b-48f5-9753-87d57143023f tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d6444c0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:21.580567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-53c48495-ec8b-48f5-9753-87d57143023f tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c2dd488b-0a71-42b9-89bc-7d5b9e9bcce2" status: 200 len: 350 microversion: 2.1 time: 0.122189 Jul 20 13:47:21.581448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 27/44] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:21 2022] GET /compute/v2.1/os-volumes/c2dd488b-0a71-42b9-89bc-7d5b9e9bcce2 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:21.586353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:21.587468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:21.620074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:21.620824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:21.622376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:21.626944 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:21.929782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:21.956286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b7e04823-a84f-492b-87f4-ea71dd02b1d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1273 microversion: 2.1 time: 0.373740 Jul 20 13:47:21.967835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 28/45] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:21 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1273 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:21.988810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:21.991889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:22.009628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:22.010310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:22.011264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:22.011870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:22.485954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:22.500431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:22.506119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:22.507277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b1563769-40aa-4c99-a917-f214d7e2ec4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1284 microversion: 2.20 time: 0.538206 Jul 20 13:47:22.507839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 29/46] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1284 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:22.544249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:22.545789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:22.574981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:22.582628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:22.587717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:22.588306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:22.775733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:22.787433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bd81ef97-788c-4345-87df-31bde398d554 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1295 microversion: 2.1 time: 0.271159 Jul 20 13:47:22.796094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 30/47] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1295 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:22.986581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:22.987449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:23.003860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:23.007241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:23.013336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:23.013948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:23.256973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:23.283184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-217f61ca-e79d-48ef-b9b0-21313d70f609 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1273 microversion: 2.1 time: 2.210750 Jul 20 13:47:23.296739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 18/48] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:21 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1273 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:23.522950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:23.526972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:23.528511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:23.534662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-46939955-0b7f-473e-aa6d-76f3c946e346 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1291 microversion: 2.1 time: 0.553676 Jul 20 13:47:23.547601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:23.548355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:23.549149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 31/49] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:22 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1291 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:23.549839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:23.550525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:23.774871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a035ce14-559b-4826-88e8-c97dfca5128f tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d5f43a0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:23.806159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:23.815979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:23.822363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:23.823773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-82768843-507f-4161-8800-8a4b2d119dd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1340 microversion: 2.20 time: 0.301448 Jul 20 13:47:23.828584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 19/50] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1340 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:47:23.841495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:23.842579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:23.855129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:23.856786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:23.861189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:23.861673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:23.918997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a035ce14-559b-4826-88e8-c97dfca5128f tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4f241556-04fb-4a22-ae36-38ea948d41bb" status: 200 len: 351 microversion: 2.1 time: 0.149288 Jul 20 13:47:23.920721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 32/51] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:23 2022] GET /compute/v2.1/os-volumes/4f241556-04fb-4a22-ae36-38ea948d41bb => generated 351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:24.195885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:24.215334 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-32790501-d788-4411-94c8-d51e725796b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1295 microversion: 2.1 time: 0.382617 Jul 20 13:47:24.219266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 20/52] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1295 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:24.300875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:24.302185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:24.313050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:24.313850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:24.316475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:24.317317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:24.554744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:24.555363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:24.589210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:24.589689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:24.590625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:24.591071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:24.722350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:24.733144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9d063a3c-9867-4629-aacd-bf154738bcb6 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1271 microversion: 2.1 time: 0.436419 Jul 20 13:47:24.739106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 33/53] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:24 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1271 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:24.847274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:24.848045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:24.868023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:24.874971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:24.876058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:24.876872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:24.950286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:24.968648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4462dbc9-675d-45f9-9cc2-b090bf115028 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1279 microversion: 2.1 time: 0.417462 Jul 20 13:47:24.969258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 21/54] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:24 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1279 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:25.238976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:25.239649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:25.260139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:25.261193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:25.262204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:25.266130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:25.308158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:25.323467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:25.325157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:25.330255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-16510fad-c352-4e47-8f5d-fa71c97144fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1338 microversion: 2.20 time: 0.488598 Jul 20 13:47:25.346492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 34/55] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1338 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:25.728402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:25.747617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7e776771-5acd-44ae-811a-9a0aceed9617 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1295 microversion: 2.1 time: 0.511682 Jul 20 13:47:25.748542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 22/56] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1295 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:25.763611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:25.764462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:25.780473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:25.780473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:25.787896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:25.788384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:25.802826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-956ad986-f7fe-4624-8056-b315e2eef15a tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d67cf70>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:25.953606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-956ad986-f7fe-4624-8056-b315e2eef15a tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ea033e0c-468f-483b-a477-36f1107aefc6" status: 200 len: 350 microversion: 2.1 time: 0.159345 Jul 20 13:47:25.954710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 23/57] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:47:25 2022] GET /compute/v2.1/os-volumes/ea033e0c-468f-483b-a477-36f1107aefc6 => generated 350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:47:25.966309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-de2846f8-fd02-49a7-b785-8850636bf0bb tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d641670>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:26.019147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:26.030114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8b9b6bb2-adb8-4916-ae61-22a2641a6116 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1271 microversion: 2.1 time: 0.268842 Jul 20 13:47:26.031259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 35/58] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:25 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:26.043489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:26.044385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:26.058097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:26.062225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:26.063734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:26.068596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:26.199264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-de2846f8-fd02-49a7-b785-8850636bf0bb tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.236964 Jul 20 13:47:26.200169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 24/59] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jul 20 13:47:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:26.216504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1b7f486-0344-433f-8b8b-0e48e5d43b22 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d641dc0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:26.236555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:26.245980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-38556f92-f97d-4d88-85e3-690302d1ef2a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1279 microversion: 2.1 time: 0.213163 Jul 20 13:47:26.251850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 36/60] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:26 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:26.354078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:26.354786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:26.365165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:26.365612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:26.374331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:26.374775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:26.460071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d1b7f486-0344-433f-8b8b-0e48e5d43b22 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.248709 Jul 20 13:47:26.460775 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 25/61] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jul 20 13:47:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:47:26.475618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-78013c91-9cfb-4489-b12c-358e5f736b9f tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d5cc700>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:26.537336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:26.553545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:26.562090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:26.563506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-db11db47-1f6e-4728-86b6-16cd8ca71ddc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1338 microversion: 2.20 time: 0.215227 Jul 20 13:47:26.572573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 37/62] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:47:26.768571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:26.770162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:26.787246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:26.790818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:26.792026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:26.794814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:26.806873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-78013c91-9cfb-4489-b12c-358e5f736b9f tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.336214 Jul 20 13:47:26.808536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 26/63] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jul 20 13:47:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:26.822716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ef3d5c8a-1f08-4a6b-9bdb-fade8f4d9c60 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d6411f0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:27.460091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ef3d5c8a-1f08-4a6b-9bdb-fade8f4d9c60 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.642610 Jul 20 13:47:27.461095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 27/64] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jul 20 13:47:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:27.487501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:27.508813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:27.598696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:27.603579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:27.614376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:27.622820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:27.700167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=4 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:28.823916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:28.853095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-de07be40-5b25-459b-94f3-79083e328077 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 2.092594 Jul 20 13:47:28.872579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 38/65] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:28.880357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:28.880964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:28.917287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:28.920542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:28.921758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:28.924123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:28.984851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=20 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:29.342997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:29.375001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fe689e60-0722-45fc-9f42-97691115e898 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 1.912057 Jul 20 13:47:29.380000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 28/66] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:27 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:29.395832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-be34b625-a8fd-4717-81e0-eb7a52a4abe3 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d641040>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:29.553865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:29.572162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:29.584545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1152d090-ebcf-4c1f-ba5c-9825dcacbd82 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1279 microversion: 2.1 time: 0.708916 Jul 20 13:47:29.595310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 39/67] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:28 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1279 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:29.597274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:29.597880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:29.608579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-be34b625-a8fd-4717-81e0-eb7a52a4abe3 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.226813 Jul 20 13:47:29.612747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 29/68] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jul 20 13:47:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:29.623654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:29.624097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:29.624831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-41300df5-24eb-402a-901a-5ed1db83d1e6 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d606a60>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:29.624964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:29.625309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:29.901779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-41300df5-24eb-402a-901a-5ed1db83d1e6 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.280766 Jul 20 13:47:29.902356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 30/69] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 13:47:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:29.913332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:29.914344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:29.949108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:29.960627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:29.965433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:29.966036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:30.721880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:30.938011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=26 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:30.994129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:31.009526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-98199e6e-a789-4c47-aa99-1e20d6e8757e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 1.106040 Jul 20 13:47:31.010383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 31/70] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:31.024220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a16eaa67-7781-4a37-bea4-a13e42c6ce87 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d5ccb80>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:31.217054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a16eaa67-7781-4a37-bea4-a13e42c6ce87 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203377 Jul 20 13:47:31.217831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 32/71] 10.222.0.17 () {58 vars in 1187 bytes} [Wed Jul 20 13:47:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:31.223256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:31.224046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:31.230957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:31.231402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:31.233383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:31.233975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:31.509779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:31.519555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:31.525648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:31.530343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae583610-ea78-483e-8e2a-e2b2e37e9a50 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 1.942004 Jul 20 13:47:31.544309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 40/72] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:31.557422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:31.562400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:31.576930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:31.577381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:31.578419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:31.588117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:31.928383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:31.938552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-42b78d72-e557-4856-ae71-d699ebaade67 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.718479 Jul 20 13:47:31.939157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 33/73] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:31 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:31.954547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6c214289-f686-4f07-a99b-79bc9d743250 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] Calling method '.version_select at 0x7fa40d619a60>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:32.214088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6c214289-f686-4f07-a99b-79bc9d743250 tempest-VolumesTestJSON-1074770990 tempest-VolumesTestJSON-1074770990-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.268474 Jul 20 13:47:32.215051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 34/74] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jul 20 13:47:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:32.221528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:32.224144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:32.246866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:32.247854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:32.250562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:32.251014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:33.487750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:33.500248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b441259e-913d-4b29-af69-48e4822a38b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 1.283824 Jul 20 13:47:33.502314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 35/75] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:33.520116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:33.520983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:33.535600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:33.536335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:33.541147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:33.541717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:33.611109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:33.623666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0bfa257b-f6b4-4ae1-b4e2-f1632808ae93 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 2.077507 Jul 20 13:47:33.624670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 41/76] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:31 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:33.717635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-7104cb78-b08b-435e-b6bc-65300d86f8a1 req-574cdc28-5bc2-421f-9113-600c4e8de6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa1a351-f890-4b69-9606-4fa868d1443d", "tag": "a7cc4326-225c-4a06-a40d-e0e89993ff52"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:33.734647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-7104cb78-b08b-435e-b6bc-65300d86f8a1 req-574cdc28-5bc2-421f-9113-600c4e8de6e5 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:33.735767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-7104cb78-b08b-435e-b6bc-65300d86f8a1 req-574cdc28-5bc2-421f-9113-600c4e8de6e5 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:33.763671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-7104cb78-b08b-435e-b6bc-65300d86f8a1 req-574cdc28-5bc2-421f-9113-600c4e8de6e5 service nova] Creating event network-changed:a7cc4326-225c-4a06-a40d-e0e89993ff52 for instance 1aa1a351-f890-4b69-9606-4fa868d1443d on hv-cinder-81914 Jul 20 13:47:33.764517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-7104cb78-b08b-435e-b6bc-65300d86f8a1 req-574cdc28-5bc2-421f-9113-600c4e8de6e5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 13:47:33.766923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab3a21fb-3e0d-47be-84c1-150a1f676f87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:33.767865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab3a21fb-3e0d-47be-84c1-150a1f676f87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:33.769000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab3a21fb-3e0d-47be-84c1-150a1f676f87 None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:33.769709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab3a21fb-3e0d-47be-84c1-150a1f676f87 None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:33.792166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.compute.rpcapi [None req-ab3a21fb-3e0d-47be-84c1-150a1f676f87 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 13:47:33.793640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab3a21fb-3e0d-47be-84c1-150a1f676f87 None None] Releasing lock "compute-rpcapi-router" {{(pid=129541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 13:47:33.820473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ab3a21fb-3e0d-47be-84c1-150a1f676f87 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193824 Jul 20 13:47:33.822717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 42/77] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:33.846182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:33.849735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:33.869157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:33.869824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:33.872005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:33.875101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:34.249075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:34.261080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:34.265339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:34.265339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-53ba4d88-471d-49c2-b228-f5e38967a733 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.749334 Jul 20 13:47:34.288338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 36/78] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:34.502690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-9e966a5f-36c2-48c0-a530-b994f07e46b1 req-1aa8db7c-fab2-4871-8c92-0e59e9ba7a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b24def-87e7-4cf1-a588-fd75e74497fe", "tag": "3fdb06b2-4cf6-4ccc-b04a-c5d386909cf7"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:34.535040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-9e966a5f-36c2-48c0-a530-b994f07e46b1 req-1aa8db7c-fab2-4871-8c92-0e59e9ba7a9b service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:34.535683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-9e966a5f-36c2-48c0-a530-b994f07e46b1 req-1aa8db7c-fab2-4871-8c92-0e59e9ba7a9b service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:34.591664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-9e966a5f-36c2-48c0-a530-b994f07e46b1 req-1aa8db7c-fab2-4871-8c92-0e59e9ba7a9b service nova] Creating event network-changed:3fdb06b2-4cf6-4ccc-b04a-c5d386909cf7 for instance 41b24def-87e7-4cf1-a588-fd75e74497fe on hv-cinder-81914 Jul 20 13:47:34.592471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-9e966a5f-36c2-48c0-a530-b994f07e46b1 req-1aa8db7c-fab2-4871-8c92-0e59e9ba7a9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=129542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 13:47:34.596159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb0aab42-6740-4af2-8d92-27b3f943207b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:34.598094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb0aab42-6740-4af2-8d92-27b3f943207b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:34.600553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb0aab42-6740-4af2-8d92-27b3f943207b None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:34.601721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb0aab42-6740-4af2-8d92-27b3f943207b None None] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:34.636830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.compute.rpcapi [None req-eb0aab42-6740-4af2-8d92-27b3f943207b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 13:47:34.637779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb0aab42-6740-4af2-8d92-27b3f943207b None None] Releasing lock "compute-rpcapi-router" {{(pid=129542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 13:47:34.676632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eb0aab42-6740-4af2-8d92-27b3f943207b None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386239 Jul 20 13:47:34.677420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 37/79] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:34.691212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:34.692171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:34.710073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:34.714265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:34.715340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:34.715926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:34.981707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:34.993489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e2f0b3b4-a9a3-4b4e-ac9c-a463cebf9747 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 1.164911 Jul 20 13:47:34.995427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 43/80] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:33 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:35.005196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:35.008107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:35.033198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:35.035857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:35.037186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:35.039924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:35.318723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:35.332315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f31798e-ed65-4f35-8b5e-fa8c793b0b6e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.335223 Jul 20 13:47:35.350823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 44/81] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:34 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:35.353452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:35.357866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:35.370816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:35.371514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:35.378099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:35.381441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:35.403809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:35.413899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-15279e58-6af7-4648-aa64-18e93c52bc92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.734725 Jul 20 13:47:35.428035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 38/82] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:35.954646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-04219f26-f16b-40c7-bfd8-738d64711013 req-82f6cedd-d1f5-407c-a601-80dee90ee0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52fcfee5-9168-4461-8523-7471fd8e81e5", "tag": "17a0147e-8a4a-49a4-88fb-0f4e99342246"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:35.969942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:35.975273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-04219f26-f16b-40c7-bfd8-738d64711013 req-82f6cedd-d1f5-407c-a601-80dee90ee0c5 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:35.976144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-04219f26-f16b-40c7-bfd8-738d64711013 req-82f6cedd-d1f5-407c-a601-80dee90ee0c5 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:35.993424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=77 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:36.016247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-04219f26-f16b-40c7-bfd8-738d64711013 req-82f6cedd-d1f5-407c-a601-80dee90ee0c5 service nova] Creating event network-changed:17a0147e-8a4a-49a4-88fb-0f4e99342246 for instance 52fcfee5-9168-4461-8523-7471fd8e81e5 on hv-cinder-81914 Jul 20 13:47:36.026844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-04219f26-f16b-40c7-bfd8-738d64711013 req-82f6cedd-d1f5-407c-a601-80dee90ee0c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078138 Jul 20 13:47:36.027448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 39/83] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:36.045421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:36.046548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:36.057553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:36.058012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:36.058805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:36.059253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:36.292461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:36.311653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:36.317227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:36.321192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cf518c45-bd63-40a2-b19a-e122a45014db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.973384 Jul 20 13:47:36.322841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 45/84] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:36.351980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:36.354060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:36.358063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:36.379601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:36.382434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:36.384824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:36.386144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:36.842303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:36.858305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-54c34d18-87e7-40f3-af80-876dbbe4de17 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.510776 Jul 20 13:47:36.864548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 46/85] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:36 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:36.880257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:36.891129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:36.907245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:36.915913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:36.918079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:36.919243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:37.102692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:37.118187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8bdddf6e-7ed9-4dde-852c-940e23468605 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 1.086879 Jul 20 13:47:37.123751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 40/86] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:36 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:37.130959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-8b7d6938-949e-4289-af76-066cfd6696d6 req-afd6b278-7eaf-45c5-b75d-dbc0c56aa40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:37.170562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-8b7d6938-949e-4289-af76-066cfd6696d6 req-afd6b278-7eaf-45c5-b75d-dbc0c56aa40a service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:37.179229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-8b7d6938-949e-4289-af76-066cfd6696d6 req-afd6b278-7eaf-45c5-b75d-dbc0c56aa40a service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:37.219681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-8b7d6938-949e-4289-af76-066cfd6696d6 req-afd6b278-7eaf-45c5-b75d-dbc0c56aa40a service nova] Creating event network-changed:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 13:47:37.243700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-8b7d6938-949e-4289-af76-066cfd6696d6 req-afd6b278-7eaf-45c5-b75d-dbc0c56aa40a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117274 Jul 20 13:47:37.254585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 41/87] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:37.349021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:37.352004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:37.361399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:37.362963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:37.363810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:37.364436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:37.663476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:37.672059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:37.680610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:37.682421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ab0d672c-934d-459a-8346-843411142adf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.343317 Jul 20 13:47:37.685912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 42/88] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:37.701157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:37.732570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-408708f6-9849-4018-8564-e03b5efc92e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.866111 Jul 20 13:47:37.734920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 47/89] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:37.880057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:37.880825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:37.892010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:37.892569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:37.893420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:37.893926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:38.142191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:38.143137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:38.153364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:38.153903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:38.155676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:38.156661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:38.347053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:38.358356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-251e5e6b-67f1-47ec-8564-3fe0f11ff00f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.222268 Jul 20 13:47:38.359030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 48/90] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:38 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:38.429550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:38.438607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dff58f10-c5a2-4b0d-bd80-ea60764206c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.562518 Jul 20 13:47:38.449327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 43/91] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:37 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:38.704269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:38.705847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:38.713278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:38.713844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:38.715141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:38.715715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:38.750230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:38.751052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:38.762903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:38.763465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:38.764527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:38.765173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:38.887492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:38.898864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:38.901880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:38.903654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2611bb1c-b4f2-42f6-a868-66115d1e98c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.204473 Jul 20 13:47:38.904791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 49/92] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:38.961710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:38.972065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-028e0765-c616-4b45-8a91-14f3ef413084 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.226336 Jul 20 13:47:38.981247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 44/93] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:38 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:39.280127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-d999b648-4710-45ea-8d52-3ba43fe0b697 req-f39e3da9-dc1c-4918-b2c5-301469ab9a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aff7de0-b167-45a5-a897-cf138b503977", "tag": "db9b4bf7-96c7-4b6e-b6fd-3290848317d5"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:39.290337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-d999b648-4710-45ea-8d52-3ba43fe0b697 req-f39e3da9-dc1c-4918-b2c5-301469ab9a04 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:39.290979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-d999b648-4710-45ea-8d52-3ba43fe0b697 req-f39e3da9-dc1c-4918-b2c5-301469ab9a04 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:39.303516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-d999b648-4710-45ea-8d52-3ba43fe0b697 req-f39e3da9-dc1c-4918-b2c5-301469ab9a04 service nova] Creating event network-changed:db9b4bf7-96c7-4b6e-b6fd-3290848317d5 for instance 9aff7de0-b167-45a5-a897-cf138b503977 on hv-cinder-81914 Jul 20 13:47:39.308891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-d999b648-4710-45ea-8d52-3ba43fe0b697 req-f39e3da9-dc1c-4918-b2c5-301469ab9a04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032465 Jul 20 13:47:39.310626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 50/94] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:39.376291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:39.376834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:39.384789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:39.386058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:39.387449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:39.388733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:39.465484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:39.465484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:39.472038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:39.472600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:39.473477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:39.473941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:39.615610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:39.624982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-484c55c8-8468-41e4-87f3-521cdc220453 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.253912 Jul 20 13:47:39.625591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 45/95] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:39 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:39.676966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:39.688429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f7127dbb-3e8d-46f1-9a5c-7d0250093f62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.234993 Jul 20 13:47:39.689789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 51/96] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:39 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:39.921966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:39.922571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:39.929693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:39.930493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:39.931406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:39.932439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:39.992222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:39.992916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:40.001230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:40.002540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:40.003633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:40.004800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:40.211319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:40.218239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:40.221634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae879eb0-2dc9-4331-bd63-46d3d57f58f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.235789 Jul 20 13:47:40.222234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 52/97] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:40.236098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:40.238746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:40.240698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e17c9c33-43ed-4287-9c36-e1fe69997633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.323229 Jul 20 13:47:40.241848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 46/98] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:40.643037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:40.643982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:40.668414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:40.669109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:40.669938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:40.670372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:40.719116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:40.721221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:40.741152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:40.742909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:40.743765 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:40.744242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:40.906564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:40.925295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1ec45a54-9e6f-4228-9829-c183ac6ec51f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.286288 Jul 20 13:47:40.926474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 53/99] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:40 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:41.044692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:41.052540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0a0e69f0-c186-45e1-9541-b6e0a6cd63a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.344063 Jul 20 13:47:41.053410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 47/100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:40 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:41.238296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:41.238925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:41.245254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:41.245925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:41.246785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:41.247754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:41.258935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:41.259899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:41.272439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:41.273114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:41.275161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:41.281423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:41.482579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:41.498899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-05d524db-db54-46ef-a3cf-ae31672994c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.263781 Jul 20 13:47:41.504617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 54/101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:41.513802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:41.525389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:41.527821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:41.530569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fad71c23-c6d7-42cf-a5c7-06c048a1077f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.275690 Jul 20 13:47:41.531616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 48/102] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:41.948505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:41.949247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:41.957892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:41.960454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:41.961911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:41.962647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:42.070177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:42.070707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:42.078493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:42.079361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:42.081292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:42.081945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:42.225155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:42.229409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:42.233143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8f8a4ccd-4d4e-40b7-9818-329dad19bb70 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.168017 Jul 20 13:47:42.238388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a227099a-1fd2-4755-b09d-b26a03d16233 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.295305 Jul 20 13:47:42.248883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 55/103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:41 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:42.249029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 49/104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:42 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:42.521182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:42.521791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:42.528109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:42.529175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:42.530329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:42.530765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:42.549109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:42.549716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:42.556519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:42.557240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:42.558167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:42.562245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:42.718382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:42.729537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9c84e3c8-cd9d-422d-8d96-d2ffdfff7416 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.211919 Jul 20 13:47:42.739596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 56/105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:42.739761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:42.749211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:42.751503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:42.752979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0ef893a2-c12d-4a60-9426-d8d5c95371bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.207697 Jul 20 13:47:42.754049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 50/106] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:43.250742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:43.251339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:43.256491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:43.257094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:43.257418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.257942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.258712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.259142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.263222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.263746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.264630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.265091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.276891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:43.386795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:43.392596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:43.394753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5c658c12-f404-4c73-86e6-e8db1573a2f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.148614 Jul 20 13:47:43.395309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 57/107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:43 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:43.399990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b153d855-1ec7-4bda-aa14-baa6029c0431 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.147276 Jul 20 13:47:43.400573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 51/108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:43 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:43.746786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:43.747916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:43.753746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.754187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.754933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.755360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.770745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:43.771348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:43.778327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.779057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.779758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:43.780176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:43.791069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:43.894771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:43.903417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7e1fa092-c736-45a9-8586-a6f2d9fdd335 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.160423 Jul 20 13:47:43.904115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 58/109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:43.959674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:43.983927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:43.991786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:43.994838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8ac43be8-b6ab-45a1-b8ad-b67e40857737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.227867 Jul 20 13:47:43.998022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 52/110] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:44.414594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:44.415207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:44.419934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:44.421591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:44.431156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:44.433528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:44.433983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:44.435857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:44.437190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:44.438089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:44.447460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:44.449816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:44.622872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:44.695896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:44.712595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89909fc1-e3be-4f4a-92fa-6663282b3ae4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.297305 Jul 20 13:47:44.713182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 53/111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:44 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:44.785697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:44.797383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8fdc2fe8-0c1c-4aa6-867b-679d871f6371 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.387761 Jul 20 13:47:44.798613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 59/112] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:44 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:44.922994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:44.923597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:44.930474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:44.930920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:44.931688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:44.933068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:45.021867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:45.022748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:45.032914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:45.033933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:45.035153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:45.035828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:45.125781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:45.139210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a04843f6-044b-4f7a-94a1-ef8ec0a88b85 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.220395 Jul 20 13:47:45.149325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 54/113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:45.212027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:45.222191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:45.224989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:45.226163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e0090492-bf98-42a4-8281-a8c088809792 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.215353 Jul 20 13:47:45.227292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 60/114] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:45.728690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:45.729303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:45.735796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:45.736264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:45.737021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:45.737448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:45.815583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:45.817085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:45.830722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:45.832566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:45.833476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:45.833922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:45.885889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:45.895336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7f3ebbdf-201e-4157-9ff7-88265373c97e tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.170313 Jul 20 13:47:45.895928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 55/115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:45 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:46.084430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:46.092890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f8361070-0b73-4faa-b9e7-53e422b3a39d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.282244 Jul 20 13:47:46.100260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 61/116] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:45 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:46.156376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:46.157385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:46.164538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:46.165262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:46.166273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:46.166705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:46.244659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:46.245268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:46.258204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:46.258688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:46.259700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:46.260324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:46.342906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:46.351536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7b30ff1d-ce4c-4686-a282-3c175407a3dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.199596 Jul 20 13:47:46.352865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 56/117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:46.646695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:46.658312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:46.660223 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:46.661841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8b4259bb-f421-4e95-8371-8f2712fcc96a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.421038 Jul 20 13:47:46.662679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 62/118] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:47:46.922346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:46.925157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:46.935311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:46.936142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:46.937419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:46.938235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:46.943660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:47.110554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:47.112011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:47.125082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:47.128287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:47.131047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:47.135007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:47.138262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6b24bb4c-d99c-4293-bcde-0b571de6dd6f tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.228648 Jul 20 13:47:47.139222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 57/119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:46 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:47.139494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:47.372560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:47.374209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:47.393087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:47.394456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:47.395099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:47.396152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:47.397582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:47.406899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a492dfc1-4591-4bdd-840e-874cdb33ce42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.300591 Jul 20 13:47:47.423208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 63/120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:47 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:47.599604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:47.609073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4d3b1d01-8bb2-48b8-9f84-0facc426c80d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.244083 Jul 20 13:47:47.610009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 58/121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:47.679529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:47.680138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:47.691153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:47.691603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:47.692415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:47.694047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:47.773273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-f14a2fb1-c1cd-441a-a574-be2caa27db9a req-54ccca2a-64ec-4d09-a6cd-466bf24fcf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52fcfee5-9168-4461-8523-7471fd8e81e5", "name": "network-vif-plugged", "status": "completed", "tag": "17a0147e-8a4a-49a4-88fb-0f4e99342246"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:47.786470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-f14a2fb1-c1cd-441a-a574-be2caa27db9a req-54ccca2a-64ec-4d09-a6cd-466bf24fcf83 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:47.787206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-f14a2fb1-c1cd-441a-a574-be2caa27db9a req-54ccca2a-64ec-4d09-a6cd-466bf24fcf83 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:47.801659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-f14a2fb1-c1cd-441a-a574-be2caa27db9a req-54ccca2a-64ec-4d09-a6cd-466bf24fcf83 service nova] Creating event network-vif-plugged:17a0147e-8a4a-49a4-88fb-0f4e99342246 for instance 52fcfee5-9168-4461-8523-7471fd8e81e5 on hv-cinder-81914 Jul 20 13:47:47.808846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-f14a2fb1-c1cd-441a-a574-be2caa27db9a req-54ccca2a-64ec-4d09-a6cd-466bf24fcf83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211746 Jul 20 13:47:47.809673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 64/122] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:47:47.924968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:47.938894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:47.941792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:47.942944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-83df4d14-35ac-4a12-8d5f-8ceb7aec7952 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.267288 Jul 20 13:47:47.944896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 59/123] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:48.157221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:48.161098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:48.180089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.185273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:48.187468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.187919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:48.425774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:48.426648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:48.434141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.435912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:48.436964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.437623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:48.672979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:48.682539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c19d9cdc-7118-4b79-8286-c9b76fb1ee4b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.261666 Jul 20 13:47:48.687550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 60/124] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:48 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:48.698674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:48.701907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:48.714721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.716048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:48.732530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.734280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:48.772632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:48.787375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6b7b4fbc-ec8b-4607-94ee-1ea254677a74 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.635082 Jul 20 13:47:48.790053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 65/125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:48 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:48.934559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:48.943283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a0ec363e-3846-4ceb-9b19-f86d996d58df tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.254473 Jul 20 13:47:48.943865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 61/126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:48.972628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:48.973724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:48.987369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.988105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:48.989074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:48.990103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:49.210199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:49.220291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:49.222439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:49.223734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c9dd39ba-4779-49cb-9eda-fafb0215e793 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.262079 Jul 20 13:47:49.237195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 66/127] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:49.705602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:49.706451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:49.719024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:49.722661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:49.725951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:49.726873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:49.806555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:49.807732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:49.818817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:49.819664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:49.821439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:49.822378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:49.990077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:50.001905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0133c934-2f3f-42d0-826f-06a0eacc857e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.299877 Jul 20 13:47:50.004033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 62/128] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:49 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:50.016171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-0d7d3d75-4135-47e2-920f-3c08f5330cb3 req-10e547ba-d640-40ee-9495-26b912178771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b24def-87e7-4cf1-a588-fd75e74497fe", "name": "network-vif-plugged", "status": "completed", "tag": "3fdb06b2-4cf6-4ccc-b04a-c5d386909cf7"}, {"server_uuid": "1aa1a351-f890-4b69-9606-4fa868d1443d", "name": "network-vif-plugged", "status": "completed", "tag": "a7cc4326-225c-4a06-a40d-e0e89993ff52"}, {"server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "name": "network-vif-plugged", "status": "completed", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:50.039014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:50.045761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-0d7d3d75-4135-47e2-920f-3c08f5330cb3 req-10e547ba-d640-40ee-9495-26b912178771 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:50.046966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-0d7d3d75-4135-47e2-920f-3c08f5330cb3 req-10e547ba-d640-40ee-9495-26b912178771 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:50.051020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b852013e-846c-42ef-ab7c-a61894b4b073 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.248435 Jul 20 13:47:50.052250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 67/129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:49 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:50.057381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:50.058252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:50.066684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:50.067447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:50.068394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:50.069032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:50.094247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-0d7d3d75-4135-47e2-920f-3c08f5330cb3 req-10e547ba-d640-40ee-9495-26b912178771 service nova] Creating event network-vif-plugged:3fdb06b2-4cf6-4ccc-b04a-c5d386909cf7 for instance 41b24def-87e7-4cf1-a588-fd75e74497fe on hv-cinder-81914 Jul 20 13:47:50.094954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-0d7d3d75-4135-47e2-920f-3c08f5330cb3 req-10e547ba-d640-40ee-9495-26b912178771 service nova] Creating event network-vif-plugged:a7cc4326-225c-4a06-a40d-e0e89993ff52 for instance 1aa1a351-f890-4b69-9606-4fa868d1443d on hv-cinder-81914 Jul 20 13:47:50.095457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-0d7d3d75-4135-47e2-920f-3c08f5330cb3 req-10e547ba-d640-40ee-9495-26b912178771 service nova] Creating event network-vif-plugged:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 13:47:50.114318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-0d7d3d75-4135-47e2-920f-3c08f5330cb3 req-10e547ba-d640-40ee-9495-26b912178771 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.108614 Jul 20 13:47:50.115502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 63/130] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:50.244907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:50.245882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:50.261744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:50.262189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:50.263076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:50.263673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:50.343757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:50.354091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c0cbfb83-4d01-4300-9bd5-d129edde9178 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.298824 Jul 20 13:47:50.355941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 68/131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:50.794533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:50.803593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:50.805487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:50.806791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dde224c9-9b19-4cef-a4da-8c24148e7999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.566094 Jul 20 13:47:50.808116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 64/132] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:51.023000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:51.023797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:51.033148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.033731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:51.034621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.035257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:51.069300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:51.070501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:51.077600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.078539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:51.080029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.080648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:51.230006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:51.238294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dc8a4d9b-5a88-4243-9f39-eea3336a32c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.219691 Jul 20 13:47:51.239393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 69/133] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:51 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:51.296606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:51.308236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-99c749d0-e0e2-4b9e-839d-ebbf5b4d93b4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.244490 Jul 20 13:47:51.309952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 65/134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:51 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:51.380174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:51.382812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:51.397089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.397552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:51.398327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.398745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:51.619998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:51.632567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-36ca960f-d135-49de-9507-47f443db459e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.262681 Jul 20 13:47:51.633724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 70/135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:51.825627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:51.826242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:51.833086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.833752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:51.834529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:51.834961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.072851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:52.087382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:52.089615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:52.091065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2a435fda-6163-4aff-87b6-8725ee4453f8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.269500 Jul 20 13:47:52.091812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 66/136] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:52.141238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-94e4f69e-da68-4705-9b4d-bf5f91e28504 req-d451939e-531f-422b-b058-261235213f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aff7de0-b167-45a5-a897-cf138b503977", "name": "network-vif-plugged", "status": "completed", "tag": "db9b4bf7-96c7-4b6e-b6fd-3290848317d5"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:52.156330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-94e4f69e-da68-4705-9b4d-bf5f91e28504 req-d451939e-531f-422b-b058-261235213f5d service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:52.157915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-94e4f69e-da68-4705-9b4d-bf5f91e28504 req-d451939e-531f-422b-b058-261235213f5d service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.194761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-94e4f69e-da68-4705-9b4d-bf5f91e28504 req-d451939e-531f-422b-b058-261235213f5d service nova] Creating event network-vif-plugged:db9b4bf7-96c7-4b6e-b6fd-3290848317d5 for instance 9aff7de0-b167-45a5-a897-cf138b503977 on hv-cinder-81914 Jul 20 13:47:52.203747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-94e4f69e-da68-4705-9b4d-bf5f91e28504 req-d451939e-531f-422b-b058-261235213f5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066584 Jul 20 13:47:52.204874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 71/137] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:52.258647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:52.259678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:52.274117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:52.275827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.276964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:52.279206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.330554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:52.331623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:52.340361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:52.340897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.342066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:52.342927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.534142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:52.545833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-023c4dd3-133d-45e1-bfce-ce6dbecd18f2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.292059 Jul 20 13:47:52.546496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 67/138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:52 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:52.565713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:52.580785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4d2c12fd-e187-4aed-b633-66682a2bdca4 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1313 microversion: 2.1 time: 0.256793 Jul 20 13:47:52.581960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:52 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:52.649916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:52.650657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:52.660611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:52.661401 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.662536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:52.663221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:52.875581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:52.883185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2de306e1-1af1-4670-89d8-8b93acdf62f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.237143 Jul 20 13:47:52.883750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 68/140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:53.110542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:53.112079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:53.118778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:53.119347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:53.120271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:53.120851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:53.270391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:53.280633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:53.282198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:53.283315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f38e1ec-8e17-435b-aec7-69b6bad32430 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1406 microversion: 2.20 time: 0.177881 Jul 20 13:47:53.284165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 73/141] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:53.565688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:53.566984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:53.583027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:53.583734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:53.584860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:53.585560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:53.598423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:53.598933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:53.609280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:53.609729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:53.610526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:53.610962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:53.938711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:53.946999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:53.947867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-94398684-36a9-40c1-a393-1f1c8b7692c9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.388872 Jul 20 13:47:53.961545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 69/142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:53 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:53.961987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fd37ce28-14b1-4f28-911d-6cf2706b8822 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1499 microversion: 2.1 time: 0.366495 Jul 20 13:47:53.964351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 74/143] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:53 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1499 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:53.979796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:53.989749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:54.004891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.005350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:54.006219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.006654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:54.212484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:54.221220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a3eb3770-2e14-4b59-81ab-b95f8dd57e5b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1363 microversion: 2.1 time: 0.257422 Jul 20 13:47:54.222076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 70/144] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:54.305970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:54.307125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:54.314808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.315260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:54.316642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.320972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:54.342629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:54.529432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:54.537856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:54.539336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:54.540531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ac696137-da4e-454c-8c36-99f9156f05ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1598 microversion: 2.20 time: 0.242939 Jul 20 13:47:54.541084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 75/145] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:47:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1598 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:47:54.559947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-71d1ba6a-bdb6-4e11-acce-f381be4d3f34 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:54.560464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-71d1ba6a-bdb6-4e11-acce-f381be4d3f34 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:54.566890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-71d1ba6a-bdb6-4e11-acce-f381be4d3f34 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.567395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-71d1ba6a-bdb6-4e11-acce-f381be4d3f34 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:54.568066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-71d1ba6a-bdb6-4e11-acce-f381be4d3f34 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.568725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-71d1ba6a-bdb6-4e11-acce-f381be4d3f34 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:54.686977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-71d1ba6a-bdb6-4e11-acce-f381be4d3f34 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.129164 Jul 20 13:47:54.687716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 71/146] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 13:47:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:47:54.970055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:54.971412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:54.977871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.978522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:54.979519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:54.980138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:55.238979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:55.239578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:55.245791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:55.246240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:55.247586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:55.248009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:55.301260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:55.310119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fa7a9eda-9f01-44ed-b777-49fe9d4cd49f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.343811 Jul 20 13:47:55.312595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 76/147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:54 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:55.402152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:55.412011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0dab6dfe-6f63-45f1-b89c-a9133356d736 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1549 microversion: 2.1 time: 0.177086 Jul 20 13:47:55.412720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 72/148] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:55.430605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bc4b1ee3-1596-40b1-bf87-b19303ce92cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:55.431384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bc4b1ee3-1596-40b1-bf87-b19303ce92cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:55.438581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4b1ee3-1596-40b1-bf87-b19303ce92cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:55.439274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4b1ee3-1596-40b1-bf87-b19303ce92cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:55.440121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4b1ee3-1596-40b1-bf87-b19303ce92cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:55.440698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4b1ee3-1596-40b1-bf87-b19303ce92cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:55.754485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bc4b1ee3-1596-40b1-bf87-b19303ce92cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.328185 Jul 20 13:47:55.755283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 77/149] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 13:47:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:56.330411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:56.331624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:56.343856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:56.344564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:56.345573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:56.346219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:56.363914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-013ef77d-83ba-45c5-b6db-38d14907775e req-23224fa4-81bf-4b44-b987-05ec9c3e832f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:56.372883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-013ef77d-83ba-45c5-b6db-38d14907775e req-23224fa4-81bf-4b44-b987-05ec9c3e832f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:56.373559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-013ef77d-83ba-45c5-b6db-38d14907775e req-23224fa4-81bf-4b44-b987-05ec9c3e832f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:56.389480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-013ef77d-83ba-45c5-b6db-38d14907775e req-23224fa4-81bf-4b44-b987-05ec9c3e832f service nova] Creating event network-changed:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 13:47:56.394761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-013ef77d-83ba-45c5-b6db-38d14907775e req-23224fa4-81bf-4b44-b987-05ec9c3e832f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034531 Jul 20 13:47:56.395374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 78/150] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:56.695599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:56.698372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-efc63931-f61a-4eed-b700-eef29dd1d9b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.373339 Jul 20 13:47:56.709050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 73/151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:56 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:47:57.284411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-a9b6e34d-9562-4c86-9c72-7c03ac4f41ab req-9350c078-e9a2-4398-9075-c647424552e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa1a351-f890-4b69-9606-4fa868d1443d", "tag": "a7cc4326-225c-4a06-a40d-e0e89993ff52"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:57.294429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-a9b6e34d-9562-4c86-9c72-7c03ac4f41ab req-9350c078-e9a2-4398-9075-c647424552e0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:57.294796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-a9b6e34d-9562-4c86-9c72-7c03ac4f41ab req-9350c078-e9a2-4398-9075-c647424552e0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:57.314521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-a9b6e34d-9562-4c86-9c72-7c03ac4f41ab req-9350c078-e9a2-4398-9075-c647424552e0 service nova] Creating event network-changed:a7cc4326-225c-4a06-a40d-e0e89993ff52 for instance 1aa1a351-f890-4b69-9606-4fa868d1443d on hv-cinder-81914 Jul 20 13:47:57.328312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-a9b6e34d-9562-4c86-9c72-7c03ac4f41ab req-9350c078-e9a2-4398-9075-c647424552e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047352 Jul 20 13:47:57.330088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 79/152] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:57.585270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c08af5ab-2833-4788-87ad-72221b421f22 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3c27ce6-4491-4cbb-9715-fe52bcb0df60"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:47:57.586463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c08af5ab-2833-4788-87ad-72221b421f22 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:57.597210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c08af5ab-2833-4788-87ad-72221b421f22 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:57.597782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c08af5ab-2833-4788-87ad-72221b421f22 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:57.598984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c08af5ab-2833-4788-87ad-72221b421f22 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:57.599613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c08af5ab-2833-4788-87ad-72221b421f22 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:57.687892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:57.717862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:57.719656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:57.735494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:57.736619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:57.738664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:57.739499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:57.954215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:57.986244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-566aeca3-4e25-4306-a1b8-fc7d196c53cf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.275044 Jul 20 13:47:57.990030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 80/153] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:57 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:47:58.547221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c08af5ab-2833-4788-87ad-72221b421f22 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "POST /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965491 Jul 20 13:47:58.549541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 74/154] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 13:47:57 2022] POST /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:47:59.009754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:47:59.010376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:47:59.017022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:59.017471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:59.018280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:47:59.018726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:47:59.184427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:47:59.193143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-69f97229-3ecd-40ba-8e46-91939f37b32a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1321 microversion: 2.1 time: 0.190279 Jul 20 13:47:59.194307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 81/155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:47:59 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:00.211616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:00.212421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:00.219224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:00.219548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:00.220328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:00.220759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:00.375902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:00.384790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-84cf92fe-173b-4d62-acf8-1c50a2a9661a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1516 microversion: 2.1 time: 0.177436 Jul 20 13:48:00.385553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 75/156] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:00 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:00.403779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:00.405878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:00.428277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:00.429000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:00.430414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:00.431117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:00.459739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lazy-loading 'flavor' on Instance uuid 9aff7de0-b167-45a5-a897-cf138b503977 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:48:00.592597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6ccb5c06-f4a3-4e64-be7e-de18788c6f48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977/action" status: 200 len: 32 microversion: 2.1 time: 0.193376 Jul 20 13:48:00.593945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 82/157] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 13:48:00 2022] POST /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 13:48:00.609456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:00.610385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:00.618172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:00.619031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:00.620181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:00.620905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:00.890457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:00.902388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9699f5bb-d755-4fe9-a52e-ef07477bf315 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.303059 Jul 20 13:48:00.903020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 76/158] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:00 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:01.920579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:01.921974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:01.929794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:01.930407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:01.931537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:01.932125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:02.120764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:02.134418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bda6ba8a-b3a4-478a-9668-c63de72fed5a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.219166 Jul 20 13:48:02.135563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 83/159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:01 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:03.154740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:03.155360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:03.162425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:03.162846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:03.164157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:03.164948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:03.627209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:03.638058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ca10f68d-22d1-4f36-834b-437e22b1584e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.486332 Jul 20 13:48:03.649891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 77/160] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:03 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:04.661510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:04.663506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:04.671503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:04.672075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:04.672972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:04.673477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:04.957205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:04.988017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f4ddcf9d-2790-46ff-a6bc-8ec163394844 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.333041 Jul 20 13:48:04.990261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 84/161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:04 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:06.008379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:06.009047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:06.013456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=78 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:06.017877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:06.018327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:06.019495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:06.020105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:06.171959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:06.182321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2c2f1bb5-44f4-4a90-948f-76019f63ba85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.178791 Jul 20 13:48:06.183317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 78/162] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:06 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:07.128460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1512895426", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "networks": [{"uuid": "0a30219f-ddfb-4def-83ae-15a40aca0479"}]}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:07.135115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=78 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:07.182928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] validate_networks() for [('0a30219f-ddfb-4def-83ae-15a40aca0479', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:48:07.202382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:07.203935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:07.210654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:07.211103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:07.211877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:07.212348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:07.356432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:07.365958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a2e0b5d0-a0dd-48fa-8c65-663c32e0296c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.168404 Jul 20 13:48:07.367217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 79/163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:07 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:07.579309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:48:07.579947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:48:07.580595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:48:07.581207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:48:07.581796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:48:07.592111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:07.592590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:07.593388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:07.593824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:07.611494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Getting quotas for project 937a900e75b4437b85994fce6c1e3ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:48:07.615411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Getting quotas for user 0e3dacd75e3a47d9bda05d873826c818 and project 937a900e75b4437b85994fce6c1e3ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:48:07.627376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:48:07.629734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:48:07.674269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eff9c0f9-ce35-441d-9327-c8b2c912d2ed tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549095 Jul 20 13:48:07.674851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 85/164] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:48:07.685743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3410b516-f8da-429f-bd41-4f409822a80b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:07.686350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3410b516-f8da-429f-bd41-4f409822a80b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:07.742758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3410b516-f8da-429f-bd41-4f409822a80b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:07.751147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3410b516-f8da-429f-bd41-4f409822a80b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1214 microversion: 2.1 time: 0.069680 Jul 20 13:48:07.751719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 80/165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:07 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:08.383097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:08.383700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:08.389884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.390400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:08.391093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.393425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:08.568321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:08.584358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a33a3d8c-698e-4a85-a6c5-bd15c6fe513e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.203885 Jul 20 13:48:08.586874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 86/166] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:08 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:08.772293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:08.774331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:08.774579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:08.775312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:08.782487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.782723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.783226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:08.783502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:08.784107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.784504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.784753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:08.785073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:08.813140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 13:48:08.853886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:08.864149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-37acfd96-c9f8-4893-a7ce-895acceece7e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.099716 Jul 20 13:48:08.864745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 81/167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:08 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:08.910721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ab8b2068-7aa0-4169-adf5-38af928dd76d tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 204 len: 0 microversion: 2.1 time: 0.140410 Jul 20 13:48:08.911173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 87/168] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:48:08 2022] DELETE /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:48:08.921013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:08.921522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:08.927705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.928158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:08.928950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:08.929381 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:09.060586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:09.068369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-15d12e04-ccb7-4ea0-9da8-3b7a694158be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.151606 Jul 20 13:48:09.068930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 82/169] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:08 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:09.610110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:09.610805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:09.616689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:09.617137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:09.617914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:09.618351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:09.776377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:09.793659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-344b231f-3123-416e-85e7-c50a499413d9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.188443 Jul 20 13:48:09.794227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 88/170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:09 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:09.881864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:09.882504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:09.891403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:09.892005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:09.893216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:09.893769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:09.960808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:09.970804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3ea97120-5d3c-4e72-8557-22a8f70afe6d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.093227 Jul 20 13:48:09.980004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 83/171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:09 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:10.086132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:10.086740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:10.092890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:10.093333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:10.094089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:10.094516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:10.232904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:10.241191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1a29b781-2804-4801-b0c0-c3cf38ab24be tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.158877 Jul 20 13:48:10.241760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 89/172] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:10 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:10.810960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:10.811568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:10.817664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:10.818108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:10.828355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:10.828836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:10.965610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:10.973221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-184ca802-8c1b-4466-8f68-bfcd44a58987 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.166533 Jul 20 13:48:10.973784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 84/173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:10 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:10.987284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:10.987888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:10.993830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:10.994270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:10.995025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:10.995451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:11.057074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:11.060638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:11.065550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17023a60-0015-44cf-88e5-3d71cd65cdfc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.082169 Jul 20 13:48:11.066134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 90/174] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:10 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:11.257884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:11.258489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:11.265135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:11.265586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:11.266352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:11.266788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:11.395181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:11.403381 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-77bfabc3-0c67-4c41-85c2-8c8defd5580b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.149345 Jul 20 13:48:11.403941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 85/175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:11 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:11.991099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:11.991785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:11.998354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:11.998793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:11.999541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:11.999962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:12.082678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:12.083318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:12.090829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:12.091281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:12.092055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:12.092515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:12.130254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:12.138354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-84d947cf-9308-411d-9a71-685ebabadca5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.151672 Jul 20 13:48:12.138970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 91/176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:11 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:12.161481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:12.170287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1430ab9e-3368-4bb5-bb59-d11b1d2c1edd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.091500 Jul 20 13:48:12.170916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 86/177] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:12 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:12.422544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:12.423644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:12.429540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:12.430104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:12.430870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:12.431302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:12.573998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:12.583852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a1c5de83-fe71-4f02-bba0-54018bc25625 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.166443 Jul 20 13:48:12.584763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 92/178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:12 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:13.155626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:13.156280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:13.162882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:13.163339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:13.164106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:13.164571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:13.187705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:13.188391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:13.194283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:13.194719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:13.195468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:13.195890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:13.257697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:13.265470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0d2ac6f6-ccb6-4a24-8657-d9ca27977762 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.081501 Jul 20 13:48:13.266260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 93/179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:13 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:13.301432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:13.309375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eef65aed-2bb7-4664-8591-a338ec610d90 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.157836 Jul 20 13:48:13.309924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 87/180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:13 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:13.601076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:13.601672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:13.608100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:13.608567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:13.609320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:13.609743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:13.752410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:13.762467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e48dff21-0686-48b1-ba0e-7ce3e64ea29c tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.164547 Jul 20 13:48:13.764356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 94/181] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:13 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:14.282665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:14.283276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:14.289713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:14.290157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:14.290914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:14.291344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:14.325345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:14.325953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:14.332211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:14.332669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:14.333432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:14.333864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:14.351663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:14.359659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-edf2c112-92f8-4ef6-9ff3-91ba3c321759 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.080815 Jul 20 13:48:14.360258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 88/182] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:14 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:14.461470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:14.469625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d452f9c9-dd3e-4b3c-bd85-174251d95467 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.147976 Jul 20 13:48:14.470193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 95/183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:14 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:14.779688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:14.780403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:14.786666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:14.787137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:14.788219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:14.788671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:14.922516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:14.930225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-43aacb5f-c6b0-474c-9ac9-03f7352e2c83 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.154597 Jul 20 13:48:14.930784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 89/184] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:14 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:15.376996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:15.377650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:15.383507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:15.383943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:15.384726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:15.385150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:15.446214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:15.453775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8aeb439d-3c09-42dd-819c-4aba2e931bfd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.080647 Jul 20 13:48:15.454331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 96/185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:15 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:15.486826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:15.487427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:15.493873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:15.494324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:15.495081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:15.495510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:15.626335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:15.633782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e6068840-61c9-48a9-8962-59e6c0bb5374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.150708 Jul 20 13:48:15.634354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 90/186] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:15 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:15.947404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:15.948006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:15.958738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:15.959259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:15.960138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:15.960622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:16.093475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:16.101261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cee0c524-2d4b-47d1-aee7-bfa2040926a3 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.157711 Jul 20 13:48:16.101818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 97/187] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:15 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:16.471081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:16.471683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:16.477995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:16.478444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:16.479321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:16.479843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:16.483885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:16.546328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:16.553593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-331c4bef-919d-4f46-8c03-1a0e251e10a2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1266 microversion: 2.1 time: 0.086449 Jul 20 13:48:16.554150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 91/188] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:16 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:16.650827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:16.651434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:16.657590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:16.658041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:16.658802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:16.659228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:16.795306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:16.804645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-685928b3-1a6d-464b-89b0-a492d6c44da4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.157546 Jul 20 13:48:16.805220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 98/189] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:16 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:17.119831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:17.120558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:17.126665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:17.128124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:17.128960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:17.129458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:17.376169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:17.386746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b7ce5f2d-db8e-48dc-9b43-a81c645e348b tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1551 microversion: 2.1 time: 0.272313 Jul 20 13:48:17.392169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 92/190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:17 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1551 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:17.572548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:17.573301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:17.581740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:17.582758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:17.583816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:17.584480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:17.610951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:17.621991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=6 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:17.684952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:17.696694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ff81e406-1986-4d3e-a2d7-86183bbd79b5 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1272 microversion: 2.1 time: 0.129288 Jul 20 13:48:17.697282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 99/191] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:17 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:17.825263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:17.826641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:17.843291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:17.852740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:17.853718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:17.857321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:17.862184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:17.962309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-2dc40d7a-dc98-4e99-9cc6-af5d0ab2cc74 req-c8885fca-706d-49c0-9037-e74905000005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b24def-87e7-4cf1-a588-fd75e74497fe", "name": "network-vif-deleted", "tag": "3fdb06b2-4cf6-4ccc-b04a-c5d386909cf7"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:17.974146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-2dc40d7a-dc98-4e99-9cc6-af5d0ab2cc74 req-c8885fca-706d-49c0-9037-e74905000005 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:17.975948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-2dc40d7a-dc98-4e99-9cc6-af5d0ab2cc74 req-c8885fca-706d-49c0-9037-e74905000005 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:18.018013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-2dc40d7a-dc98-4e99-9cc6-af5d0ab2cc74 req-c8885fca-706d-49c0-9037-e74905000005 service nova] Creating event network-vif-deleted:3fdb06b2-4cf6-4ccc-b04a-c5d386909cf7 for instance 41b24def-87e7-4cf1-a588-fd75e74497fe on hv-cinder-81914 Jul 20 13:48:18.037442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-2dc40d7a-dc98-4e99-9cc6-af5d0ab2cc74 req-c8885fca-706d-49c0-9037-e74905000005 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076068 Jul 20 13:48:18.039767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 100/192] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:48:18.269008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:18.284724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3fd96f8f-9419-4988-8551-c3ef126e5b92 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.465906 Jul 20 13:48:18.302244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 93/193] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:17 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:18.405050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:18.405805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:18.419515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:18.419885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:18.421987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:18.423718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:18.544679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419fced725134a31bee9907051f2621b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:18.557040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-10db81ac-a6eb-48d2-a8f8-33c04abecb98 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 200 len: 1344 microversion: 2.1 time: 0.156343 Jul 20 13:48:18.560599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 101/194] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:18 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 1344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:18.715896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:18.716543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:18.725682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:18.726134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:18.729539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:18.730816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:18.976556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:18.985669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-53ac5f41-90e6-4208-82ec-7a51a7f607f2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.274601 Jul 20 13:48:18.986781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 94/195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:18 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:19.302170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:19.303721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:19.310213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:19.310652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:19.311413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:19.311860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:19.378735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-f3a40054-8352-4ff3-846c-bab62114ce55 req-d8cbb192-12a7-46d7-9525-c92004e3aac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b0e39d-5329-4f9a-9229-a5734feebd1f", "tag": "e6568758-0282-4101-95dc-e932245c820c"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:19.393755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f3a40054-8352-4ff3-846c-bab62114ce55 req-d8cbb192-12a7-46d7-9525-c92004e3aac1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:19.394749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f3a40054-8352-4ff3-846c-bab62114ce55 req-d8cbb192-12a7-46d7-9525-c92004e3aac1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:19.415912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-f3a40054-8352-4ff3-846c-bab62114ce55 req-d8cbb192-12a7-46d7-9525-c92004e3aac1 service nova] Creating event network-changed:e6568758-0282-4101-95dc-e932245c820c for instance 80b0e39d-5329-4f9a-9229-a5734feebd1f on hv-cinder-81914 Jul 20 13:48:19.425240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-f3a40054-8352-4ff3-846c-bab62114ce55 req-d8cbb192-12a7-46d7-9525-c92004e3aac1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049974 Jul 20 13:48:19.425846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 95/196] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:48:19.524414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:19.532981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe6a1834-21b5-4766-a960-d6950f7d8ed0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.234506 Jul 20 13:48:19.533919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 102/197] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:19 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:19.575242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:19.576217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:19.582948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:19.583620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:19.584435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:19.584877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:19.599201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] HTTP exception thrown: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Request method failure captured: Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe HTTP/1.1 Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdiRdGkCjU-_WluFt-Fja2JkWIkK4Q4adG16cBtf8imXUF6d7sjYKsL2EfRH54Kfmo2Ang8r_6UVqmc9EhLrClgHetLiYgoKGEjIHsN-A0lHae6dhCqXjEtW-W_3m_ClIWvBkQx6C6KMDT16wU6jMUu5FyR2XphjSX2Q1QTIugMyEM Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:48:19.604814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}] Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: 419fced725134a31bee9907051f2621b Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.606269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '41b24def-87e7-4cf1-a588-fd75e74497fe'} Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:19.607071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.608393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.610809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Returning 404 to user: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:19.611896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4ce95a52-e0ff-4016-bcc7-fdb50e2de6bc tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 404 len: 111 microversion: 2.1 time: 0.041608 Jul 20 13:48:19.612958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 96/198] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:19 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:48:19.742664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:19.743588 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:19.752397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:19.753398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:19.754869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:19.755299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:19.770822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] HTTP exception thrown: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Request method failure captured: Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe/os-volume_attachments HTTP/1.1 Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdiRdGkCjU-_WluFt-Fja2JkWIkK4Q4adG16cBtf8imXUF6d7sjYKsL2EfRH54Kfmo2Ang8r_6UVqmc9EhLrClgHetLiYgoKGEjIHsN-A0lHae6dhCqXjEtW-W_3m_ClIWvBkQx6C6KMDT16wU6jMUu5FyR2XphjSX2Q1QTIugMyEM Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:19.778859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}] Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 419fced725134a31bee9907051f2621b Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.780150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'server_id': '41b24def-87e7-4cf1-a588-fd75e74497fe'} Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:19.780977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:19.782066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:19.784337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Returning 404 to user: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:19.785515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7839f189-ba58-4240-a2e8-f5389dfd28d9 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046787 Jul 20 13:48:19.786527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 103/199] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:48:19 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:48:20.004612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:20.005782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:20.015713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:20.017099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:20.018085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:20.019854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:20.266013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:20.274174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-600d9557-62b1-43cc-a673-8edffc1082c6 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.274777 Jul 20 13:48:20.275440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 97/200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:19 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:20.550730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:20.552064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:20.559857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:20.560554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:20.561317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:20.561896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:20.710872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:20.721064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6189d9c1-d889-4464-9f80-0f6eb7fa3dde tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.174331 Jul 20 13:48:20.722044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 104/201] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:20 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:21.085707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:21.086183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:21.092647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.093088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.093851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.094277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.107659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] HTTP exception thrown: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Request method failure captured: Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: DELETE /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe HTTP/1.1 Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdiRdGkCjU-_WluFt-Fja2JkWIkK4Q4adG16cBtf8imXUF6d7sjYKsL2EfRH54Kfmo2Ang8r_6UVqmc9EhLrClgHetLiYgoKGEjIHsN-A0lHae6dhCqXjEtW-W_3m_ClIWvBkQx6C6KMDT16wU6jMUu5FyR2XphjSX2Q1QTIugMyEM Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:48:21.109253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}] Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: 419fced725134a31bee9907051f2621b Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.110988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '41b24def-87e7-4cf1-a588-fd75e74497fe'} Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:21.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.112902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.113983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Returning 404 to user: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:21.113983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3b042110-da71-4e22-b040-70dde418b1ad tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "DELETE /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 404 len: 111 microversion: 2.1 time: 0.028715 Jul 20 13:48:21.114235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 98/202] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:48:21 2022] DELETE /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:48:21.119609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:21.121122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] [instance: 41b24def-87e7-4cf1-a588-fd75e74497fe] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:21.128404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.128849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.129613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.130044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.143729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] HTTP exception thrown: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Request method failure captured: Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe HTTP/1.1 Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdiRdGkCjU-_WluFt-Fja2JkWIkK4Q4adG16cBtf8imXUF6d7sjYKsL2EfRH54Kfmo2Ang8r_6UVqmc9EhLrClgHetLiYgoKGEjIHsN-A0lHae6dhCqXjEtW-W_3m_ClIWvBkQx6C6KMDT16wU6jMUu5FyR2XphjSX2Q1QTIugMyEM Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:21.145976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f4d1a070c0624b1e9e0b12d5eb0cb0b5"}]}] Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f4d1a070c0624b1e9e0b12d5eb0cb0b5 Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-DeleteServersTestJSON-1921502055 Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 419fced725134a31bee9907051f2621b Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-DeleteServersTestJSON-1921502055-project Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.147134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '41b24def-87e7-4cf1-a588-fd75e74497fe'} Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:21.147773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. Jul 20 13:48:21.152990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:21.154611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] Returning 404 to user: Instance 41b24def-87e7-4cf1-a588-fd75e74497fe could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:21.154611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d7825167-04b7-4007-b6c1-0971a6dc0c78 tempest-DeleteServersTestJSON-1921502055 tempest-DeleteServersTestJSON-1921502055-project] 10.222.0.17 "GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe" status: 404 len: 111 microversion: 2.1 time: 0.032088 Jul 20 13:48:21.154611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 105/203] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:21 2022] GET /compute/v2.1/servers/41b24def-87e7-4cf1-a588-fd75e74497fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:48:21.293771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:21.294400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:21.301473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.301919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.302681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.303355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.741724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:21.741724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:21.746011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.746843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.747949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:21.748644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:21.769584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:21.780590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5925b85b-a323-402e-b0a3-145e03c1cf6a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.491860 Jul 20 13:48:21.800263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 99/204] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:21 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:21.901611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:21.910061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0a591a35-6955-4648-bc25-e14ebff96766 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.175170 Jul 20 13:48:21.910717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 106/205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:21 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:22.797575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:22.798089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:22.804505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:22.804948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:22.805705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:22.806137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:22.927252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:22.927863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:22.934611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:22.935058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:22.935823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:22.936284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:23.022385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:23.030104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-42f7d80f-cbf5-4c37-ada0-1f819c0d69ef tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.236304 Jul 20 13:48:23.030683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 100/206] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:22 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:23.082215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:23.091053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b614b1ee-89be-46e9-8ca7-edf0812cf118 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.167661 Jul 20 13:48:23.091655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 107/207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:22 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:24.049546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:24.050150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:24.068754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:24.069105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:24.070264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:24.070345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:24.109246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:24.111080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:24.117957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:24.119544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:24.121875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:24.122840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:24.489239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:24.518566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4bb625a6-9f2e-4a2f-834a-fa26b0d62dd7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.408183 Jul 20 13:48:24.520687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 108/208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:24 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:24.533975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1904528815", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "networks": [{"uuid": "84a0ba6f-be05-4959-abc1-12c33510b7d9"}]}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:24.644457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] validate_networks() for [('84a0ba6f-be05-4959-abc1-12c33510b7d9', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:48:24.874959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:24.892323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8c4a8e73-5d13-4444-ba80-08580dc0e55d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.846307 Jul 20 13:48:24.893948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 101/209] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:24 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:25.535908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:25.536641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:25.547066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:25.547574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:25.548460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:25.549085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:25.593822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:48:25.594861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:48:25.595621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:48:25.596266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:48:25.597571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:48:25.612838 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:25.613279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:25.614322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:25.614863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:25.640357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Getting quotas for project 1ddc6ae060994d16b13ff53e80813e83. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:48:25.655252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Getting quotas for user a3e5180dc37741919bc068f5e2302850 and project 1ddc6ae060994d16b13ff53e80813e83. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:48:25.666901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:48:25.669833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:48:25.710225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:25.720254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a3d0b467-1ad1-4e70-ad5d-5f1fa0c3b16c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197265 Jul 20 13:48:25.721259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 109/210] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:48:25.732121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-22f62b53-c373-465f-a6f6-c487ac35d3ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:25.733169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-22f62b53-c373-465f-a6f6-c487ac35d3ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:25.733616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5cfa3276-8b3d-4d07-be4c-e31898bc8648 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.201218 Jul 20 13:48:25.737139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 102/211] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:25 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:25.809274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-22f62b53-c373-465f-a6f6-c487ac35d3ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:25.820392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-22f62b53-c373-465f-a6f6-c487ac35d3ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1219 microversion: 2.1 time: 0.092908 Jul 20 13:48:25.820969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 110/212] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:25 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:25.916845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:25.926153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:25.936318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:25.936318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:25.936985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:25.937288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:26.190701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:26.198124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bdef9f50-0ab8-4d97-8590-7854d2cfb2f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.285738 Jul 20 13:48:26.199444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 103/213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:25 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:26.750896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:26.751518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:26.758412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:26.758924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:26.759757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:26.760295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:26.765060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:26.838773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:26.840081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:26.847189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:26.847664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:26.848688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:26.849467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:26.909091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:26.914086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-708929a0-9f37-4db8-840b-d9a3ec3e5e02 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.167243 Jul 20 13:48:26.924605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 111/214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:26 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:26.944701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:26.958183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-356e76c4-93d2-42d5-bed5-b6a22a9ea1cf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1271 microversion: 2.1 time: 0.123407 Jul 20 13:48:26.959159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 104/215] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:26 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:27.216716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:27.217907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:27.225978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:27.226647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:27.228247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:27.228963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:27.293828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-27038668-bac3-4dbe-a38f-9e5f484d8a18 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Action: 'create', calling method: .version_select at 0x7fa40defd670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-452660000", "metadata": {"Type": "work"}}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-27038668-bac3-4dbe-a38f-9e5f484d8a18 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Request method failure captured: Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 121 Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AeqT4JSMoIxjyXAK3YyOChW47bglsNwC8AL3SczQiQxy9-NhGqTucan_HYGLvKYjgDeDM1HZs3b-2ObzHjfIWfztO1pJblZXiEfaFYNPDD4BP4AF_7P9GLgxWo9gJWHOGDtCChB_ZkQ6nvsFdK_5Us-6ll1EACYUJPV5xMozaeu8UE Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:27.330176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/125a038c446947eda44845b495bb6a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_125a038c446947eda44845b495bb6a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}] Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 0c2c74c32db0435084b149d7926c8c81 Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-452660000", "metadata": {"Type": "work"}}} Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: Jul 20 13:48:27.331430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-452660000', 'metadata': {'Type': 'work'}}}} Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise error Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:27.332308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 13:48:27.333423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 13:48:27.335791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 13:48:27.335791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.335791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-27038668-bac3-4dbe-a38f-9e5f484d8a18 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:27.335791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-27038668-bac3-4dbe-a38f-9e5f484d8a18 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.232303 Jul 20 13:48:27.335791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 112/216] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 13:48:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 234 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 13:48:27.344521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28f33c1d-3d48-44f8-8769-dfc9b211805f tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Action: 'create', calling method: .version_select at 0x7fa40d35a700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2126544051", "metadata": {"Type": "work"}}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28f33c1d-3d48-44f8-8769-dfc9b211805f tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Request method failure captured: Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 120 Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AeqT4JSMoIxjyXAK3YyOChW47bglsNwC8AL3SczQiQxy9-NhGqTucan_HYGLvKYjgDeDM1HZs3b-2ObzHjfIWfztO1pJblZXiEfaFYNPDD4BP4AF_7P9GLgxWo9gJWHOGDtCChB_ZkQ6nvsFdK_5Us-6ll1EACYUJPV5xMozaeu8UE Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:27.347028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/125a038c446947eda44845b495bb6a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_125a038c446947eda44845b495bb6a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}] Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 0c2c74c32db0435084b149d7926c8c81 Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2126544051", "metadata": {"Type": "work"}}} Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: Jul 20 13:48:27.349026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2126544051', 'metadata': {'Type': 'work'}}}} Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise error Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi '0' Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:27.350108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 13:48:27.353439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 13:48:27.356856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 13:48:27.356856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.356856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28f33c1d-3d48-44f8-8769-dfc9b211805f tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:27.356856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28f33c1d-3d48-44f8-8769-dfc9b211805f tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009560 Jul 20 13:48:27.356856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 113/217] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 13:48:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 13:48:27.359865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c263be16-ae70-4616-aaab-7de5d64879b6 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Action: 'create', calling method: .version_select at 0x7fa40d4a40d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1800441884", "metadata": {"Type": "work"}}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c263be16-ae70-4616-aaab-7de5d64879b6 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Request method failure captured: Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 119 Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AeqT4JSMoIxjyXAK3YyOChW47bglsNwC8AL3SczQiQxy9-NhGqTucan_HYGLvKYjgDeDM1HZs3b-2ObzHjfIWfztO1pJblZXiEfaFYNPDD4BP4AF_7P9GLgxWo9gJWHOGDtCChB_ZkQ6nvsFdK_5Us-6ll1EACYUJPV5xMozaeu8UE Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:27.362113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/125a038c446947eda44845b495bb6a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_125a038c446947eda44845b495bb6a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}] Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 0c2c74c32db0435084b149d7926c8c81 Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1800441884", "metadata": {"Type": "work"}}} Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: Jul 20 13:48:27.365388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1800441884', 'metadata': {'Type': 'work'}}}} Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise error Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi '' Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:27.366462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 13:48:27.370065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 13:48:27.372653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 13:48:27.372653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.372653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c263be16-ae70-4616-aaab-7de5d64879b6 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:27.372653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c263be16-ae70-4616-aaab-7de5d64879b6 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008810 Jul 20 13:48:27.372653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 114/218] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jul 20 13:48:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 13:48:27.373177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e0a9d0f-8902-40de-bc5c-eb302c0bbee7 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Calling method '.version_select at 0x7fa40d3a6d30>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:27.402685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-1e0a9d0f-8902-40de-bc5c-eb302c0bbee7 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] HTTP exception thrown: Volume tempest-invalid-1821271502 could not be found. Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e0a9d0f-8902-40de-bc5c-eb302c0bbee7 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Request method failure captured: Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1821271502 HTTP/1.1 Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AeqT4JSMoIxjyXAK3YyOChW47bglsNwC8AL3SczQiQxy9-NhGqTucan_HYGLvKYjgDeDM1HZs3b-2ObzHjfIWfztO1pJblZXiEfaFYNPDD4BP4AF_7P9GLgxWo9gJWHOGDtCChB_ZkQ6nvsFdK_5Us-6ll1EACYUJPV5xMozaeu8UE Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:27.405268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/125a038c446947eda44845b495bb6a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_125a038c446947eda44845b495bb6a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}] Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 0c2c74c32db0435084b149d7926c8c81 Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Volume tempest-invalid-1821271502 could not be found. Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': 'tempest-invalid-1821271502'} Jul 20 13:48:27.406523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1821271502 could not be found. (HTTP 404) (Request-ID: req-fc421091-4ca1-4896-8073-07882201134f) Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.407218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 13:48:27.412273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1821271502 could not be found. Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:27.413699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1821271502 could not be found. Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1821271502 could not be found. Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e0a9d0f-8902-40de-bc5c-eb302c0bbee7 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Returning 404 to user: Volume tempest-invalid-1821271502 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1e0a9d0f-8902-40de-bc5c-eb302c0bbee7 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1821271502" status: 404 len: 99 microversion: 2.1 time: 0.037676 Jul 20 13:48:27.415404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 115/219] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 13:48:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1821271502 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 13:48:27.421164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f3c42478-6cde-44af-8515-2e1ec79dab30 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008242 Jul 20 13:48:27.421688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 116/220] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jul 20 13:48:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 13:48:27.430728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-44992e23-dce9-4f9e-8b31-1bcc789532bb tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003986 Jul 20 13:48:27.431228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 117/221] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jul 20 13:48:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 13:48:27.441652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db5281b9-5239-45e4-81c8-7b2f340bd493 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Calling method '.version_select at 0x7fa40d3a6310>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:27.447602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:27.456219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fa869c20-b813-4aaa-a994-c730de0a74c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.244852 Jul 20 13:48:27.465534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 105/222] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:27 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:27.477919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-db5281b9-5239-45e4-81c8-7b2f340bd493 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] HTTP exception thrown: Volume 6da3facc-33c5-4378-aace-feb41a8a10a4 could not be found. Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db5281b9-5239-45e4-81c8-7b2f340bd493 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Request method failure captured: Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/os-volumes/6da3facc-33c5-4378-aace-feb41a8a10a4 HTTP/1.1 Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AeqT4JSMoIxjyXAK3YyOChW47bglsNwC8AL3SczQiQxy9-NhGqTucan_HYGLvKYjgDeDM1HZs3b-2ObzHjfIWfztO1pJblZXiEfaFYNPDD4BP4AF_7P9GLgxWo9gJWHOGDtCChB_ZkQ6nvsFdK_5Us-6ll1EACYUJPV5xMozaeu8UE Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:27.480407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/125a038c446947eda44845b495bb6a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_125a038c446947eda44845b495bb6a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}] Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 0c2c74c32db0435084b149d7926c8c81 Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Volume 6da3facc-33c5-4378-aace-feb41a8a10a4 could not be found. Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '6da3facc-33c5-4378-aace-feb41a8a10a4'} Jul 20 13:48:27.481624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6da3facc-33c5-4378-aace-feb41a8a10a4 could not be found. (HTTP 404) (Request-ID: req-11644573-e6c4-42cf-a6e9-b38d9ce31fce) Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.482306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 13:48:27.483385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6da3facc-33c5-4378-aace-feb41a8a10a4 could not be found. Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 13:48:27.484419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6da3facc-33c5-4378-aace-feb41a8a10a4 could not be found. Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6da3facc-33c5-4378-aace-feb41a8a10a4 could not be found. Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db5281b9-5239-45e4-81c8-7b2f340bd493 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Returning 404 to user: Volume 6da3facc-33c5-4378-aace-feb41a8a10a4 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-db5281b9-5239-45e4-81c8-7b2f340bd493 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6da3facc-33c5-4378-aace-feb41a8a10a4" status: 404 len: 109 microversion: 2.1 time: 0.044716 Jul 20 13:48:27.485419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 118/223] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 13:48:27 2022] DELETE /compute/v2.1/os-volumes/6da3facc-33c5-4378-aace-feb41a8a10a4 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:48:27.491744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7c8608f3-9227-449c-a67f-e7d9b4bc2972 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Calling method '.version_select at 0x7fa40d3ab040>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:27.520684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-7c8608f3-9227-449c-a67f-e7d9b4bc2972 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] HTTP exception thrown: Volume 214b3c10-a7df-4242-bc4a-65fc1618c2fe could not be found. Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7c8608f3-9227-449c-a67f-e7d9b4bc2972 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Request method failure captured: Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/os-volumes/214b3c10-a7df-4242-bc4a-65fc1618c2fe HTTP/1.1 Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AeqT4JSMoIxjyXAK3YyOChW47bglsNwC8AL3SczQiQxy9-NhGqTucan_HYGLvKYjgDeDM1HZs3b-2ObzHjfIWfztO1pJblZXiEfaFYNPDD4BP4AF_7P9GLgxWo9gJWHOGDtCChB_ZkQ6nvsFdK_5Us-6ll1EACYUJPV5xMozaeu8UE Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:48:27.523028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/125a038c446947eda44845b495bb6a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_125a038c446947eda44845b495bb6a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/125a038c446947eda44845b495bb6a4d"}]}] Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 125a038c446947eda44845b495bb6a4d Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-VolumesNegativeTest-2096054956 Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: 0c2c74c32db0435084b149d7926c8c81 Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-VolumesNegativeTest-2096054956-project Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Volume 214b3c10-a7df-4242-bc4a-65fc1618c2fe could not be found. Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '214b3c10-a7df-4242-bc4a-65fc1618c2fe'} Jul 20 13:48:27.524452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 214b3c10-a7df-4242-bc4a-65fc1618c2fe could not be found. (HTTP 404) (Request-ID: req-7e1f4246-62c1-4f1a-a9dc-8950ee8666eb) Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.525188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 13:48:27.526176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 214b3c10-a7df-4242-bc4a-65fc1618c2fe could not be found. Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 13:48:27.527751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 214b3c10-a7df-4242-bc4a-65fc1618c2fe could not be found. Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 214b3c10-a7df-4242-bc4a-65fc1618c2fe could not be found. Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7c8608f3-9227-449c-a67f-e7d9b4bc2972 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] Returning 404 to user: Volume 214b3c10-a7df-4242-bc4a-65fc1618c2fe could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7c8608f3-9227-449c-a67f-e7d9b4bc2972 tempest-VolumesNegativeTest-2096054956 tempest-VolumesNegativeTest-2096054956-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/214b3c10-a7df-4242-bc4a-65fc1618c2fe" status: 404 len: 109 microversion: 2.1 time: 0.036651 Jul 20 13:48:27.529064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 106/224] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jul 20 13:48:27 2022] GET /compute/v2.1/os-volumes/214b3c10-a7df-4242-bc4a-65fc1618c2fe => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:48:27.930746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:27.931361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:27.940796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:27.941352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:27.942413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:27.942911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:27.980696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:27.981497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:27.993868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:27.995072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:27.996524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:27.997064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:28.159579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:28.169394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3c28b3f2-742c-4f0e-9d3c-543335295a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.242323 Jul 20 13:48:28.170660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 119/225] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:27 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:28.213503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:28.237788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7bcb690c-5a01-43f5-a382-a03506095951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.258427 Jul 20 13:48:28.237788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 107/226] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:27 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:28.473657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:28.474511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:28.481419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:28.482343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:28.483264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:28.483841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:28.603173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-c291d652-1e6f-4d74-a97f-75ebfcd00c51 req-9704d0ae-d78d-4d4b-8a41-54de0dc686f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b0e39d-5329-4f9a-9229-a5734feebd1f", "name": "network-vif-plugged", "status": "completed", "tag": "e6568758-0282-4101-95dc-e932245c820c"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:28.626122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-c291d652-1e6f-4d74-a97f-75ebfcd00c51 req-9704d0ae-d78d-4d4b-8a41-54de0dc686f6 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:28.627132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-c291d652-1e6f-4d74-a97f-75ebfcd00c51 req-9704d0ae-d78d-4d4b-8a41-54de0dc686f6 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:28.657680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-c291d652-1e6f-4d74-a97f-75ebfcd00c51 req-9704d0ae-d78d-4d4b-8a41-54de0dc686f6 service nova] Creating event network-vif-plugged:e6568758-0282-4101-95dc-e932245c820c for instance 80b0e39d-5329-4f9a-9229-a5734feebd1f on hv-cinder-81914 Jul 20 13:48:28.665938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-c291d652-1e6f-4d74-a97f-75ebfcd00c51 req-9704d0ae-d78d-4d4b-8a41-54de0dc686f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068544 Jul 20 13:48:28.669857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 108/227] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:48:28.704813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-e94f0afc-a55e-4e1d-92b9-dc3061873262 req-61a57b3a-6f84-402a-921d-e4d9bdee91d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a941e2-485c-40b8-9a3a-10cbfcd13160", "tag": "539a56a6-22d1-407b-b6cb-825ad44c4901"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:28.716614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-e94f0afc-a55e-4e1d-92b9-dc3061873262 req-61a57b3a-6f84-402a-921d-e4d9bdee91d4 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:28.717351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-e94f0afc-a55e-4e1d-92b9-dc3061873262 req-61a57b3a-6f84-402a-921d-e4d9bdee91d4 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:28.740576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-e94f0afc-a55e-4e1d-92b9-dc3061873262 req-61a57b3a-6f84-402a-921d-e4d9bdee91d4 service nova] Creating event network-changed:539a56a6-22d1-407b-b6cb-825ad44c4901 for instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 on hv-cinder-81914 Jul 20 13:48:28.751243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-e94f0afc-a55e-4e1d-92b9-dc3061873262 req-61a57b3a-6f84-402a-921d-e4d9bdee91d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053887 Jul 20 13:48:28.753648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 109/228] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:48:28.814551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:28.838613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fad09a40-69a2-4e04-be7d-5daf6bb9032c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.368726 Jul 20 13:48:28.840361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 120/229] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:28 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:29.190268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:29.190955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:29.198667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:29.199374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:29.200153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:29.200658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:29.250683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:29.251872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:29.259705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:29.260164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:29.261003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:29.261446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:29.457638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:29.465791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0bfd28db-5a0a-41df-9125-d2298020bba4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.219122 Jul 20 13:48:29.466451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 121/230] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:29 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:29.489740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:29.499746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bea34ad2-08fe-4631-99b0-8e739efd02a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.313838 Jul 20 13:48:29.501332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 110/231] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:29 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:29.857323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:29.858311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:29.864392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:29.864833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:29.865789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:29.866226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:30.009117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:30.017778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3b53c345-6b06-4a1e-bb48-2641305cf536 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.164316 Jul 20 13:48:30.018560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 122/232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:29 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:30.483438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:30.484144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:30.491291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:30.491576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:30.492393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:30.493840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:30.520645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:30.521907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:30.529888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:30.530538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:30.531610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:30.532215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:30.660476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:30.666878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6756697d-3b8e-4089-9043-18bc8c47ce65 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.188046 Jul 20 13:48:30.672649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 111/233] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:30 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:30.715245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:30.722865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b40c831-dff3-4b5e-b4cb-09c0a27b4dd8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.206512 Jul 20 13:48:30.723631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 123/234] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:30 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:31.034813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:31.035420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:31.041348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:31.042063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:31.043365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:31.044020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:31.048390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:31.256968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:31.266205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-20016652-5b0c-478a-b652-9004b7b90073 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1314 microversion: 2.1 time: 0.235240 Jul 20 13:48:31.267056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 112/235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:31 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:31.690748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:31.692713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:31.696063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:31.703949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:31.704628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:31.705491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:31.705912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:31.740475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:31.741059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:31.748544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:31.748994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:31.749775 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:31.750214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:31.896973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:31.907761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4a817ff0-351a-4e11-9864-3897c4f1789b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.221795 Jul 20 13:48:31.908501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 124/236] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:31 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:31.963319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:31.976304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-08c78a5e-2efa-48eb-b6d1-3f2fa1dcd722 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.240949 Jul 20 13:48:31.978970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 113/237] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:31 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:32.283976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:32.284713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:32.292300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:32.292983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:32.293895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:32.294389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:32.436453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:32.445234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bc47bf45-195b-43fd-a923-6df1907cbd75 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1497 microversion: 2.1 time: 0.165092 Jul 20 13:48:32.446295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 125/238] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:32 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:32.924543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:32.925146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:32.931512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:32.931964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:32.933129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:32.933564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:32.997461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:32.998832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:33.005376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:33.006034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:33.006808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:33.007240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:33.166360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:33.175052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-629994a0-6e42-41d7-a233-0a15cedf38ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.182809 Jul 20 13:48:33.175626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 126/239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:32 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:33.180284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:33.180947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:33.187824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:33.188505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:33.189640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:33.190242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:33.216542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 13:48:33.220917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:33.229389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8f7d587a-2945-4c69-9935-5bd37289aa21 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.308541 Jul 20 13:48:33.240440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 114/240] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:32 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:33.335480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3d4ab8c0-ca83-43ad-b562-0ba3aac78cec tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 204 len: 0 microversion: 2.1 time: 0.155006 Jul 20 13:48:33.340421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 127/241] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:48:33 2022] DELETE /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:48:33.347861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:33.348665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:33.356843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:33.357495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:33.358545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:33.359142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:33.543147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:33.551294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff02655b-f01a-4e0c-bf05-e49e57dbe404 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1503 microversion: 2.1 time: 0.208665 Jul 20 13:48:33.551872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 115/242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:33 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:34.193635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:34.194478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:34.201049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:34.201501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:34.202315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:34.202754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:34.248488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:34.249868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:34.258551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:34.259291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:34.260827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:34.261531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:34.388801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:34.396688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7be44217-120e-4d71-9192-c77c055e4ede tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.207647 Jul 20 13:48:34.397662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 128/243] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:34 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:34.437832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:34.445619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-84de7db3-1787-46ef-baa0-765b186e1f2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.202234 Jul 20 13:48:34.446251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 116/244] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:34 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:34.569189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:34.569795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:34.576607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:34.577058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:34.578070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:34.578506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:34.657480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-aff27487-625c-43e8-be63-815f500ba3fc req-8b5f845f-fdf6-4406-bf92-54399ba9b7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a941e2-485c-40b8-9a3a-10cbfcd13160", "name": "network-vif-plugged", "status": "completed", "tag": "539a56a6-22d1-407b-b6cb-825ad44c4901"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:34.667677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-aff27487-625c-43e8-be63-815f500ba3fc req-8b5f845f-fdf6-4406-bf92-54399ba9b7f3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:34.668379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-aff27487-625c-43e8-be63-815f500ba3fc req-8b5f845f-fdf6-4406-bf92-54399ba9b7f3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:34.680395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-aff27487-625c-43e8-be63-815f500ba3fc req-8b5f845f-fdf6-4406-bf92-54399ba9b7f3 service nova] Creating event network-vif-plugged:539a56a6-22d1-407b-b6cb-825ad44c4901 for instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 on hv-cinder-81914 Jul 20 13:48:34.686255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-aff27487-625c-43e8-be63-815f500ba3fc req-8b5f845f-fdf6-4406-bf92-54399ba9b7f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Jul 20 13:48:34.687011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 117/245] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:48:34.721762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:34.731214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-02f09102-7730-4278-91db-de56cbae505c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1503 microversion: 2.1 time: 0.165992 Jul 20 13:48:34.731789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 129/246] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:34 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:35.416048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:35.416786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:35.426131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:35.426546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:35.428440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:35.429908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:35.463848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:35.464499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:35.470902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:35.471346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:35.476614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:35.477067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:35.624641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:35.646373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:35.656475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-028e2915-2264-4d7a-91fd-97ac5e9ea892 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.245776 Jul 20 13:48:35.657473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 118/247] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:35 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:35.686454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:35.695886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aa19dd56-e307-4bcd-a016-ef96eee8bf71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.236925 Jul 20 13:48:35.696979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 130/248] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:35 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:35.749129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:35.749738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:35.755879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:35.756354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:35.757125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:35.757560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:36.143795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:36.155031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f6f431e3-0fd2-4cce-8f98-40c17f7fb91c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1503 microversion: 2.1 time: 0.409897 Jul 20 13:48:36.155977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 119/249] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:35 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1503 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:36.298541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-89897408-b9f0-4e71-b239-e86b06287260 req-8a9a6265-655e-46c4-b2cf-3965eeffa3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b0e39d-5329-4f9a-9229-a5734feebd1f", "name": "network-vif-deleted", "tag": "e6568758-0282-4101-95dc-e932245c820c"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:36.302036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=8 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:36.308741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-89897408-b9f0-4e71-b239-e86b06287260 req-8a9a6265-655e-46c4-b2cf-3965eeffa3f0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:36.309179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-89897408-b9f0-4e71-b239-e86b06287260 req-8a9a6265-655e-46c4-b2cf-3965eeffa3f0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:36.320432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-89897408-b9f0-4e71-b239-e86b06287260 req-8a9a6265-655e-46c4-b2cf-3965eeffa3f0 service nova] Creating event network-vif-deleted:e6568758-0282-4101-95dc-e932245c820c for instance 80b0e39d-5329-4f9a-9229-a5734feebd1f on hv-cinder-81914 Jul 20 13:48:36.325137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-89897408-b9f0-4e71-b239-e86b06287260 req-8a9a6265-655e-46c4-b2cf-3965eeffa3f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030240 Jul 20 13:48:36.325707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 131/250] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:48:36.673967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:36.674570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:36.677396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=84 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:36.683116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:36.683786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:36.684590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:36.685068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:36.715853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:36.717405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:36.726442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:36.726887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:36.728000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:36.728617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:36.834881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:36.843794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-694a0744-fd11-4d1e-8fec-dad775a02d5c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.174368 Jul 20 13:48:36.844388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 120/251] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:36 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:36.890972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:36.898758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-81c19a97-e583-4140-93c5-4d094c05799f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1319 microversion: 2.1 time: 0.188710 Jul 20 13:48:36.899388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 132/252] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:36 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:37.174733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:37.175427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:37.183676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:37.184659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:37.186570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:37.187233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:37.224491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:37.224491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:37.224960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lazy-loading 'fault' on Instance uuid 80b0e39d-5329-4f9a-9229-a5734feebd1f {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:48:37.280263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:37.292607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8335c517-b908-4176-a353-d36d1f3f4f7c tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1304 microversion: 2.1 time: 0.121685 Jul 20 13:48:37.293359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 121/253] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:37 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:37.861178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:37.861784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:37.867654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:37.868091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:37.868887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:37.869315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:37.915981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:37.916708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:37.935310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:37.936025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:37.945255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:37.945558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:38.039598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:38.043234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:38.047995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-56b430bd-6882-4240-8358-667151117c27 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.190736 Jul 20 13:48:38.058437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 133/254] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:37 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:38.092210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:38.099925 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f2f2a23a-04f5-4b84-9db1-3ee982c16b76 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1509 microversion: 2.1 time: 0.188683 Jul 20 13:48:38.100468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 122/255] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:37 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:38.311028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:38.311629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:38.320461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:38.320919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:38.321680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:38.322102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:38.357023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:38.357382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:38.358005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lazy-loading 'fault' on Instance uuid 80b0e39d-5329-4f9a-9229-a5734feebd1f {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:48:38.440101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:38.450484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-70ca6ef1-e1b0-4f0e-b820-d0693057fb08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 200 len: 1304 microversion: 2.1 time: 0.143592 Jul 20 13:48:38.451126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 134/256] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:38 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:39.069572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:39.070970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:39.084287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:39.087688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:39.091273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:39.092772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:39.251145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:39.258600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ca5f592f-c43f-459e-80a7-bec5033e0b2f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.196303 Jul 20 13:48:39.259187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 123/257] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:39 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:39.469414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:39.470148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: 80b0e39d-5329-4f9a-9229-a5734feebd1f] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:39.476426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:39.476862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:39.477788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:39.478216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:39.495725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] HTTP exception thrown: Instance 80b0e39d-5329-4f9a-9229-a5734feebd1f could not be found. Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Request method failure captured: Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f HTTP/1.1 Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AeUQNsKW5OmSQHGQPgEZCsnP5jl3SOm8yzCh7YN56Lgm74ZDizR3Jd2sr41yaRrLmUZR6xysH2ufsj7fAuWI6gr5-pzaANH8O3RSdeRb9Up7sdczVLlKaLDqpEm6AiNunIFSi4yo-pkJ_N0UG3-HcOnjKDRhJCsYMXADLcky0JV_JQ Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 937a900e75b4437b85994fce6c1e3ce4 Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesActionsTest-2142449006 Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:48:39.497696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/937a900e75b4437b85994fce6c1e3ce4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_937a900e75b4437b85994fce6c1e3ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/937a900e75b4437b85994fce6c1e3ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/937a900e75b4437b85994fce6c1e3ce4"}]}] Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesActionsTest-2142449006 Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 937a900e75b4437b85994fce6c1e3ce4 Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesActionsTest-2142449006 Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesActionsTest-2142449006-project Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 0e3dacd75e3a47d9bda05d873826c818 Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesActionsTest-2142449006-project Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 80b0e39d-5329-4f9a-9229-a5734feebd1f could not be found. Jul 20 13:48:39.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '80b0e39d-5329-4f9a-9229-a5734feebd1f'} Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b0e39d-5329-4f9a-9229-a5734feebd1f could not be found. Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:48:39.500004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b0e39d-5329-4f9a-9229-a5734feebd1f could not be found. Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b0e39d-5329-4f9a-9229-a5734feebd1f could not be found. Jul 20 13:48:39.501147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:48:39.502200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Returning 404 to user: Instance 80b0e39d-5329-4f9a-9229-a5734feebd1f could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:48:39.502200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-376fdbf6-f8e6-4d33-ac66-168d0e09cdae tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f" status: 404 len: 111 microversion: 2.1 time: 0.033739 Jul 20 13:48:39.502200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 135/258] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:39 2022] GET /compute/v2.1/servers/80b0e39d-5329-4f9a-9229-a5734feebd1f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:48:39.673828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-577229500", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "networks": [{"uuid": "0a30219f-ddfb-4def-83ae-15a40aca0479"}]}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:40.281121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:40.282109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:40.289743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:40.290186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:40.291115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:40.292410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:40.483551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:40.492638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5d1e7a22-5602-4a08-9e95-d66bf0179cb4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.220337 Jul 20 13:48:40.493864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 136/259] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:40 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:41.510317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:41.510999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:41.517070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:41.517691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:41.518634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:41.519212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:41.679279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:41.687758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-727cac13-f652-4279-b2ba-9a980ebd0109 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.181284 Jul 20 13:48:41.688479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 137/260] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:41 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:42.705698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:42.706317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:42.712699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:42.713150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:42.714227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:42.714669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:42.761391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] validate_networks() for [('0a30219f-ddfb-4def-83ae-15a40aca0479', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:48:42.851096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:42.859683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3c225208-bb06-419f-abcf-4023b7e9ed47 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.158167 Jul 20 13:48:42.860472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 138/261] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:42 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:43.165258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:48:43.165743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:48:43.166207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:48:43.166672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:48:43.167083 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:48:43.176201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:43.176663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:43.177460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:43.177900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:43.195613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Getting quotas for project 937a900e75b4437b85994fce6c1e3ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:48:43.200337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Getting quotas for user 0e3dacd75e3a47d9bda05d873826c818 and project 937a900e75b4437b85994fce6c1e3ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:48:43.215575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:48:43.219882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:48:43.273520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-69f9b5d2-ae32-499d-992f-fda414f6348d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.603768 Jul 20 13:48:43.274544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 124/262] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 13:48:43.285132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c5bd8b0e-efa3-4a77-b577-d39b3bac0836 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:43.285444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1171640785", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:43.286377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c5bd8b0e-efa3-4a77-b577-d39b3bac0836 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:43.344673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] validate_networks() for None {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:48:43.355803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c5bd8b0e-efa3-4a77-b577-d39b3bac0836 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:43.362996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c5bd8b0e-efa3-4a77-b577-d39b3bac0836 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1213 microversion: 2.1 time: 0.081596 Jul 20 13:48:43.363760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 139/263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:43 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:43.631023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:48:43.631440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:48:43.631900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:48:43.632325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:48:43.632912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:48:43.642313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:43.642767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:43.643568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:43.644004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:43.661910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Getting quotas for project ce96512fcc7c47e8a3a572318630be2b. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:48:43.673681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Getting quotas for user 3283bab75b9b47a9924eb68fd8ae7bc1 and project ce96512fcc7c47e8a3a572318630be2b. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:48:43.687537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:48:43.689836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:48:43.739238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ce0bbc9b-28a7-4dba-8bac-6ea39ee378ff tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457803 Jul 20 13:48:43.740209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 125/264] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:48:43.751012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-33419552-5f96-4c01-8220-b2d5d8300d07 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:43.751619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-33419552-5f96-4c01-8220-b2d5d8300d07 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:43.821947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33419552-5f96-4c01-8220-b2d5d8300d07 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:43.831927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-33419552-5f96-4c01-8220-b2d5d8300d07 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1215 microversion: 2.1 time: 0.083013 Jul 20 13:48:43.833325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 140/265] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:43 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:43.877426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:43.878387 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:43.886336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:43.886779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:43.887542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:43.888789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:44.036807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:44.044327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-95e89adb-9e04-4389-8cf3-ecf06cb41007 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.171097 Jul 20 13:48:44.044895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 126/266] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:43 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:44.383754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:44.390091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:44.415466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:44.415466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:44.415466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:44.415466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:44.513021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:44.521114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2f3d39ed-9478-41f7-823d-3d07db0617f3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1265 microversion: 2.1 time: 0.143675 Jul 20 13:48:44.521688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 141/267] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:44 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:44.850603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:44.851221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:44.857694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:44.858115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:44.858881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:44.859307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:44.924599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:44.933010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7363e049-ae12-4f77-96cb-0799f0c3a6ed tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1267 microversion: 2.1 time: 0.085623 Jul 20 13:48:44.933588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 127/268] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:44 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:45.060900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:45.061536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:45.068294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:45.068749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:45.069526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:45.070128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:45.293938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:45.311048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4ff2c61c-3e27-4d32-9f3f-1cdee1d308b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.254420 Jul 20 13:48:45.318772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 142/269] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:45 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:45.541659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:45.542559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:45.555667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:45.556380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:45.557928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:45.559118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:45.806750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:45.814359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8ff5e053-0bd3-4a62-bf9c-d513c96cd952 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.277819 Jul 20 13:48:45.814937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 128/270] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:45 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:45.953316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:45.954312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:45.962261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:45.962841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:45.963794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:45.964401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:46.042465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:46.054690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-289ab8b2-862a-45af-8523-acf6f1f94ee6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1273 microversion: 2.1 time: 0.107018 Jul 20 13:48:46.055669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 143/271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:45 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:46.105316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-a29e9af7-f96f-4624-8113-598dd62eca64 req-1b24c6c2-5db5-4fa3-ade3-cd5e35f07783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1af6c57-9173-4fbf-88fd-ca721404f2b3", "tag": "aa383dff-ea0c-4a47-a440-b5bf52c0bd07"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:46.118876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-a29e9af7-f96f-4624-8113-598dd62eca64 req-1b24c6c2-5db5-4fa3-ade3-cd5e35f07783 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:46.119613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-a29e9af7-f96f-4624-8113-598dd62eca64 req-1b24c6c2-5db5-4fa3-ade3-cd5e35f07783 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:46.131557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-a29e9af7-f96f-4624-8113-598dd62eca64 req-1b24c6c2-5db5-4fa3-ade3-cd5e35f07783 service nova] Creating event network-changed:aa383dff-ea0c-4a47-a440-b5bf52c0bd07 for instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 on hv-cinder-81914 Jul 20 13:48:46.136925 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-a29e9af7-f96f-4624-8113-598dd62eca64 req-1b24c6c2-5db5-4fa3-ade3-cd5e35f07783 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035712 Jul 20 13:48:46.137770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 129/272] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:48:46.336364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:46.337608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:46.344984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:46.345670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:46.346697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:46.347323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:46.545040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:46.554844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9419ff2d-0337-43cc-a6b9-926c1c3734e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.223502 Jul 20 13:48:46.567309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 144/273] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:46 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:46.833239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:46.834286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:46.841033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:46.843947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:46.844864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:46.845909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:47.054029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-cbe1d909-90f5-42ba-8928-0b582abf3158 req-c3a811c8-bd7f-4a13-befa-cf1d8acfc8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd436784-42aa-4eb2-8a32-eda88350ecba", "tag": "38a7dfaf-cb74-45cf-9519-0686064f97f4"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:47.063455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-cbe1d909-90f5-42ba-8928-0b582abf3158 req-c3a811c8-bd7f-4a13-befa-cf1d8acfc8cc service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:47.064119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-cbe1d909-90f5-42ba-8928-0b582abf3158 req-c3a811c8-bd7f-4a13-befa-cf1d8acfc8cc service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:47.085256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-cbe1d909-90f5-42ba-8928-0b582abf3158 req-c3a811c8-bd7f-4a13-befa-cf1d8acfc8cc service nova] Creating event network-changed:38a7dfaf-cb74-45cf-9519-0686064f97f4 for instance fd436784-42aa-4eb2-8a32-eda88350ecba on hv-cinder-81914 Jul 20 13:48:47.090139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:47.092608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-cbe1d909-90f5-42ba-8928-0b582abf3158 req-c3a811c8-bd7f-4a13-befa-cf1d8acfc8cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042605 Jul 20 13:48:47.094049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 145/274] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:48:47.108799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8e6715cc-aa2e-46e3-a2c6-0a33866fa1c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.279693 Jul 20 13:48:47.110918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:47.111414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 130/275] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:46 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:47.111883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:47.118971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:47.119590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:47.120550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:47.121061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:47.290142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:47.298770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f19f9b41-0bc2-4aa0-bc0d-dda32609f212 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.203101 Jul 20 13:48:47.299337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 146/276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:47 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:47.573964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:47.574745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:47.581798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:47.582272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:47.583105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:47.583548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:47.586224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:47.718392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:47.726265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89bd918f-06dc-44fe-99a3-b9793a923457 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.156322 Jul 20 13:48:47.726766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 131/277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:47 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:48.127569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:48.128111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:48.134014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:48.134459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:48.135253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:48.135682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:48.261527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:48.270138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4fee3120-03c6-4f02-9472-28bbfe1316a3 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.146515 Jul 20 13:48:48.270739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 147/278] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:48 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:48.316583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:48.319385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:48.326110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:48.326770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:48.327647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:48.328517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:48.552127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:48.564024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-877ce1c9-5457-42ed-9c0d-18cd883a2cea tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.251421 Jul 20 13:48:48.566014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 132/279] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:48 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:48.746098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:48.746098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:48.750465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:48.750903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:48.751674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:48.752097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:49.175267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:49.183885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d87dc52e-2f8e-4fac-ad1f-da43932559c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.444815 Jul 20 13:48:49.184436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 148/280] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:48 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:49.287233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:49.287887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:49.296078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:49.296593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:49.297475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:49.297950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:49.453171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:49.460684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-430fbed5-cc40-4b43-9ef8-a6c1147183c7 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.177463 Jul 20 13:48:49.461246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 133/281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:49 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:49.582914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:49.583516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:49.590157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:49.590624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:49.591438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:49.591868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:49.729435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:49.736775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5b1c6313-23d2-4558-a6aa-641b3c041fbc tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.157692 Jul 20 13:48:49.737340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 149/282] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:49 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:50.201189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:50.201794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:50.209226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:50.209754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:50.210615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:50.211147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:50.477415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:50.478123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:50.478245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:50.484585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:50.485032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:50.485796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:50.485923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1fc89ad4-3f93-4179-ad18-e8aebf46ef8a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.289666 Jul 20 13:48:50.486230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:50.486485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 134/283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:50 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:50.630622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:50.639014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1812ad32-0851-4610-ba9b-a5f06d544e5d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.165746 Jul 20 13:48:50.639581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 150/284] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:50 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:50.754926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:50.755579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:50.761811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:50.762260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:50.763064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:50.763724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:50.895157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:50.903635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ad972d68-b600-48f5-b197-316d7c8f8c46 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.152568 Jul 20 13:48:50.904344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 135/285] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:50 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:51.503223 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:51.503816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:51.509791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:51.510873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:51.511709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:51.512142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:51.656398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:51.657165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:51.659717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:51.664767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:51.665343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:51.666287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:51.667118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:51.667274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5376e3f4-0121-4084-bf63-70a369f27bfe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.167874 Jul 20 13:48:51.667998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 151/286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:51 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:51.805583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:51.814740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-22bd4490-31e2-4c74-b691-7b6b3046ebde tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.162483 Jul 20 13:48:51.815552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 136/287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:51 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:51.921283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:51.921889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:51.927806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:51.928287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:51.929048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:51.929476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:52.062714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:52.070135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bce95e76-9410-438e-9868-ddd5e0dc3ab4 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.152659 Jul 20 13:48:52.070697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 152/288] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:51 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:52.684671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:52.685408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:52.692049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:52.692544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:52.693330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:52.693778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:52.832450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:52.833215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:52.835161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:52.839894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:52.840374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:52.841145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:52.841742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:52.845463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-64acf4a5-e527-4dfd-8ade-5b8bfa44e613 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.165207 Jul 20 13:48:52.846635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 137/289] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:52 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:52.864147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:52.988818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:52.998470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-733d87e1-35a1-4cae-966a-aa95f8c87adb tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.170014 Jul 20 13:48:52.999131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 153/290] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:52 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:53.090924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:53.091455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:53.098070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:53.098522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:53.099299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:53.099736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:53.467984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:53.476220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1b1f84a4-7145-42fe-aaca-190f2a0af0ba tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.389573 Jul 20 13:48:53.477045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 138/291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:53 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:53.862701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:53.863609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:53.865429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=4 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:53.870773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:53.871214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:53.871972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:53.872425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:54.015575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:54.016758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:54.019014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=4 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:54.019936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=12 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:54.026049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:54.037974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:54.038289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:54.038289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:54.038289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:54.038656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-93621b2e-319a-40a3-9f7d-8ab0449c57c5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.179223 Jul 20 13:48:54.039477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 154/292] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:53 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:54.181541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:54.189061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-570f70fa-dd01-4029-8fb7-8def58807ffd tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.177742 Jul 20 13:48:54.189620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 139/293] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:54 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:54.505984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:54.507108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:54.516698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:54.517645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:54.518573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:54.519346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:54.666211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:54.673614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a4a30cdb-9678-413d-9f07-0590d5ec8f8c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.172601 Jul 20 13:48:54.674181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 155/294] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:54 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:55.056310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:55.057037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:55.063689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:55.064181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:55.064979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:55.065416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:55.193357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:55.201525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ea46ae55-a497-494c-b7c4-5f16ac1424c1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.149024 Jul 20 13:48:55.202143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 140/295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:55 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:55.206358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:55.206957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:55.212946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:55.213350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:55.214098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:55.214517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:55.347759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:55.355463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4dfc1f99-5a38-493f-b1d9-db9feb20f7ea tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.153235 Jul 20 13:48:55.356031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 156/296] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:55 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:55.454752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-344096f6-f629-4a60-a571-515c6ce6d384 req-f97f29b7-9dec-4a12-9303-1f759e4becea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1af6c57-9173-4fbf-88fd-ca721404f2b3", "name": "network-vif-plugged", "status": "completed", "tag": "aa383dff-ea0c-4a47-a440-b5bf52c0bd07"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:55.463941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-344096f6-f629-4a60-a571-515c6ce6d384 req-f97f29b7-9dec-4a12-9303-1f759e4becea service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:55.464584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-344096f6-f629-4a60-a571-515c6ce6d384 req-f97f29b7-9dec-4a12-9303-1f759e4becea service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:55.477390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-344096f6-f629-4a60-a571-515c6ce6d384 req-f97f29b7-9dec-4a12-9303-1f759e4becea service nova] Creating event network-vif-plugged:aa383dff-ea0c-4a47-a440-b5bf52c0bd07 for instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 on hv-cinder-81914 Jul 20 13:48:55.482678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-344096f6-f629-4a60-a571-515c6ce6d384 req-f97f29b7-9dec-4a12-9303-1f759e4becea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Jul 20 13:48:55.483543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 141/297] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:48:55.690846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:55.691448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:55.698186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:55.698522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:55.699292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:55.700635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:55.833612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:55.842460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dfcad04c-e7a8-4da3-ae85-24c945d3028a tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.155332 Jul 20 13:48:55.842962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 157/298] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:55 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:56.218958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:56.220473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:56.226826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:56.227380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:56.228161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:56.228630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:56.373369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:56.374108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:56.380102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:56.380600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:56.381361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:56.381788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:56.399778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:56.407378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46e3c113-58f3-46a2-909d-109f62a81a59 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.193177 Jul 20 13:48:56.409749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 142/299] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:56 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:56.517814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:56.525280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cee63cc5-4694-4e0d-86e2-1be9c608280d tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.156392 Jul 20 13:48:56.526442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 158/300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:56 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:56.859746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:56.860286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:56.866247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:56.866692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:56.867451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:56.867878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:56.996326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:57.003550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-734be779-114a-463b-ad78-84442d6b37d5 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.147775 Jul 20 13:48:57.004104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 143/301] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:56 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:57.424962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:57.425564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:57.431590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:57.432542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:57.433303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:57.433730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:57.540132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-42c41ef2-b9c6-4642-bad7-6ddbc57801cc req-d61b8b91-b86a-47c6-b0c1-3abf75da08f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd436784-42aa-4eb2-8a32-eda88350ecba", "name": "network-vif-plugged", "status": "completed", "tag": "38a7dfaf-cb74-45cf-9519-0686064f97f4"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:48:57.549225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-42c41ef2-b9c6-4642-bad7-6ddbc57801cc req-d61b8b91-b86a-47c6-b0c1-3abf75da08f0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:57.549873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-42c41ef2-b9c6-4642-bad7-6ddbc57801cc req-d61b8b91-b86a-47c6-b0c1-3abf75da08f0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:57.561975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-42c41ef2-b9c6-4642-bad7-6ddbc57801cc req-d61b8b91-b86a-47c6-b0c1-3abf75da08f0 service nova] Creating event network-vif-plugged:38a7dfaf-cb74-45cf-9519-0686064f97f4 for instance fd436784-42aa-4eb2-8a32-eda88350ecba on hv-cinder-81914 Jul 20 13:48:57.566410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:57.571405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-42c41ef2-b9c6-4642-bad7-6ddbc57801cc req-d61b8b91-b86a-47c6-b0c1-3abf75da08f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037081 Jul 20 13:48:57.572324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 144/302] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:48:57.575663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e440a4d9-dd25-4d32-b6e3-f7fc6955a401 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.154480 Jul 20 13:48:57.576486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 159/303] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:57 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:57.589543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:57.590273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:57.596731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:57.597176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:57.597950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:57.598380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:57.731858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:57.739559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-74e49520-104c-436d-a4f7-4c4c5d00dace tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1313 microversion: 2.1 time: 0.165416 Jul 20 13:48:57.740121 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 145/304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:57 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:58.021716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:58.022376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:58.029020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:58.029471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:58.030234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:58.030672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:58.166724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:58.174069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8748c0ae-201a-48ab-9f43-156d21fc2abd tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.157114 Jul 20 13:48:58.174631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 160/305] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:58 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:58.594375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:58.595065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:58.601660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:58.602104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:58.602880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:58.603306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:58.746895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:58.754441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0ce5e6a5-e01f-4b32-b23d-76762905d3a8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1522 microversion: 2.1 time: 0.163992 Jul 20 13:48:58.755079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 146/306] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:58 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:58.755990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:58.757141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:58.763585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:58.764104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:58.765220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:58.765718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:58.915792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:58.923227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-927c6096-401d-4fbe-b201-cf162d629735 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1496 microversion: 2.1 time: 0.171201 Jul 20 13:48:58.923781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 161/307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:58 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:59.190899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:59.191551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:59.201461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.201461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.201461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.201461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.357329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:59.374554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fbf345da-46f2-4d62-ac94-39a965915189 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.187463 Jul 20 13:48:59.375144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 147/308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:59 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:59.528046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:59.528664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:59.534535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.534976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.535727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.536180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.564804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 13:48:59.774557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:59.775207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:59.788006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.788595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9cffcd3f-c4f6-41b0-abc7-58b589fe8af9 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 204 len: 0 microversion: 2.1 time: 0.264751 Jul 20 13:48:59.789178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 162/309] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:48:59 2022] DELETE /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:48:59.793585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.794428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.795039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.797861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:59.798843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:59.807833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.808559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.809628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.810275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.955214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:59.965186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-818848d9-a5a5-454e-a91d-79ed172dda9e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1502 microversion: 2.1 time: 0.197119 Jul 20 13:48:59.966666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 148/310] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:59 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:48:59.976841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:48:59.982934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:48:59.983474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:48:59.985887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7f286762-0d3c-477e-8ec8-eddc15b0488f tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1502 microversion: 2.1 time: 0.191919 Jul 20 13:48:59.987425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 163/311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:59 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:48:59.995149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.995518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:48:59.996428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:48:59.996858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:00.002649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:00.137608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:00.145007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e7506148-4748-4a91-a16a-48c6d33bbdf3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1516 microversion: 2.1 time: 0.166010 Jul 20 13:49:00.145554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 149/312] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:48:59 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:00.394071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:00.395196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:00.403554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:00.404075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:00.405115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:00.405620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:00.548252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:00.555561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bbc73f99-6910-4ab5-bef8-93f406fc380b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.166029 Jul 20 13:49:00.556141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 164/313] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:00 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:01.004309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:01.004974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:01.011990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:01.012457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:01.013218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:01.013648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:01.147046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:01.154981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-634a40dc-ee5b-4510-a283-a3eb6620292e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1502 microversion: 2.1 time: 0.154494 Jul 20 13:49:01.155535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 150/314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:00 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:01.571297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:01.571935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:01.574452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:01.580004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:01.580477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:01.581250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:01.581683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:01.712279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:01.719453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-95e0dc81-1a60-4bd7-be12-701284aa6bb6 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.151983 Jul 20 13:49:01.720015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 165/315] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:01 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:02.171728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:02.172294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:02.178736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:02.179179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:02.179936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:02.180397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:02.311439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:02.318771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ef189c16-934b-4bd6-be6c-067c18687d08 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1502 microversion: 2.1 time: 0.150862 Jul 20 13:49:02.319307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 151/316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:02 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:02.736641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:02.737250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:02.743206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:02.743706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:02.745110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:02.745546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:02.875331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:02.882747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f95243ab-9d91-4f64-8374-1f31f0f0c87c tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.150020 Jul 20 13:49:02.883302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 166/317] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:02 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:03.334761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:03.335325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:03.341733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:03.342178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:03.342930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:03.343359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:03.482426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:03.489805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aed126a0-b408-4fc7-8770-81819d15b13a tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1502 microversion: 2.1 time: 0.158938 Jul 20 13:49:03.490360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 152/318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:03 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:03.900404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:03.901086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:03.909670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:03.910350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:03.911493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:03.912185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.053277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:04.061326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eaad4ad5-ab23-4b5e-85b3-51be40718d7f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.164917 Jul 20 13:49:04.061889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 167/319] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:03 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:04.506514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:04.507137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:04.514461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.514901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.515653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.516077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.645148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:04.646276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:04.649532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:04.653215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.653708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.654529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.654975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.657471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-90f07f39-5faf-4a80-af65-7a14838cab24 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1502 microversion: 2.1 time: 0.154819 Jul 20 13:49:04.658035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 153/320] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:04 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:04.674395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:04.682970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lazy-loading 'flavor' on Instance uuid 52fcfee5-9168-4461-8523-7471fd8e81e5 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:04.755447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3831707d-2916-4fbb-9a6a-5cbfab1d9180 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5/action" status: 200 len: 32 microversion: 2.1 time: 0.114584 Jul 20 13:49:04.755962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 168/321] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 13:49:04 2022] POST /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 13:49:04.765080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:04.765724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:04.771791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.772259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.773018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.773455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.860453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b2667383-cc16-4015-b541-b81e74476a3c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:04.861041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b2667383-cc16-4015-b541-b81e74476a3c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:04.867188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b2667383-cc16-4015-b541-b81e74476a3c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.867628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b2667383-cc16-4015-b541-b81e74476a3c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.868414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b2667383-cc16-4015-b541-b81e74476a3c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:04.868840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b2667383-cc16-4015-b541-b81e74476a3c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:04.894398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b2667383-cc16-4015-b541-b81e74476a3c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/ips" status: 200 len: 152 microversion: 2.20 time: 0.038065 Jul 20 13:49:04.895134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 169/322] 10.222.0.17 () {60 vars in 1288 bytes} [Wed Jul 20 13:49:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:49:04.910579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:04.918176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c5293de-7c33-4b4c-943c-d67e29bcc14e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.157000 Jul 20 13:49:04.918794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 154/323] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:04 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:05.078869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:05.084963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:05.101625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:05.108460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:05.110014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:05.110580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:05.501375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:05.531547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a038d7e5-ff55-43e8-a60b-e796a656e457 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1315 microversion: 2.1 time: 0.454878 Jul 20 13:49:05.533685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 170/324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:05 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:05.674874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:05.676129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:05.678460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:05.684837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:05.684944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:05.685688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:05.686118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:05.811685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:05.819720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c61605b1-a063-4d1b-8496-cae71273af9e tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1460 microversion: 2.1 time: 0.148657 Jul 20 13:49:05.820319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 155/325] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:05 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1460 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:05.846934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-9da0242e-2ce4-4431-91a2-985b00c17206 req-ed18149d-210e-485d-a886-058ac50809d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1af6c57-9173-4fbf-88fd-ca721404f2b3", "name": "network-vif-deleted", "tag": "aa383dff-ea0c-4a47-a440-b5bf52c0bd07"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:05.855786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-9da0242e-2ce4-4431-91a2-985b00c17206 req-ed18149d-210e-485d-a886-058ac50809d1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:05.856276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-9da0242e-2ce4-4431-91a2-985b00c17206 req-ed18149d-210e-485d-a886-058ac50809d1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:05.868218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-9da0242e-2ce4-4431-91a2-985b00c17206 req-ed18149d-210e-485d-a886-058ac50809d1 service nova] Creating event network-vif-deleted:aa383dff-ea0c-4a47-a440-b5bf52c0bd07 for instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 on hv-cinder-81914 Jul 20 13:49:05.873578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-9da0242e-2ce4-4431-91a2-985b00c17206 req-ed18149d-210e-485d-a886-058ac50809d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Jul 20 13:49:05.874160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 171/326] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:49:05.935627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:05.936265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:05.942190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:05.942633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:05.943404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:05.943826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.072824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:06.080698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0229d035-5a36-4f8f-a7ea-691d336ac5c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.149722 Jul 20 13:49:06.081298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 156/327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:05 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:06.107850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cda16b93-2be6-4a74-8844-8f02d01eeb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:06.108456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cda16b93-2be6-4a74-8844-8f02d01eeb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:06.114578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cda16b93-2be6-4a74-8844-8f02d01eeb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.115134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cda16b93-2be6-4a74-8844-8f02d01eeb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.115995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cda16b93-2be6-4a74-8844-8f02d01eeb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.116325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cda16b93-2be6-4a74-8844-8f02d01eeb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.140598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cda16b93-2be6-4a74-8844-8f02d01eeb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/ips" status: 200 len: 146 microversion: 2.1 time: 0.037418 Jul 20 13:49:06.141153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 172/328] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 13:49:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:49:06.550183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:06.550807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:06.569845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.570403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.571235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.571714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.754070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:06.761838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-98ac63e7-2d49-4335-9917-003f432ae473 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1464 microversion: 2.1 time: 0.215399 Jul 20 13:49:06.762806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 157/329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:06 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:06.801877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:06.802363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:06.808355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.808798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.809567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.810024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.834668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 13:49:06.840488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:06.841039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:06.847087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.847526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.848333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.848755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.879568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.880001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.880456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lazy-loading 'fault' on Instance uuid d1af6c57-9173-4fbf-88fd-ca721404f2b3 {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:06.911314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-791d4eac-4884-46a8-b693-d283ada7dc94 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 204 len: 0 microversion: 2.1 time: 0.112948 Jul 20 13:49:06.912084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 173/330] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:49:06 2022] DELETE /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:49:06.921181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:06.921870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:06.922953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:06.927846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.928320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.929082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:06.929533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:06.930554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-df8281cf-8c3f-43f0-86e9-2363dd0ce520 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1303 microversion: 2.1 time: 0.096019 Jul 20 13:49:06.941832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 158/331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:06 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:07.059921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:07.067536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-557e7c5b-3541-40cb-9c7a-ca7bfc5d4b30 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1470 microversion: 2.1 time: 0.150544 Jul 20 13:49:07.068095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 174/332] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:06 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:07.098708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:07.099231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:07.105648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:07.106089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:07.106840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:07.107268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:07.267210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:07.275498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4a7dea57-2709-4033-9e53-0f9127174acd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.180564 Jul 20 13:49:07.284870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 159/333] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:07 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:07.949863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:07.950472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:07.958419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:07.959037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:07.959810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:07.960306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:07.990260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:07.990708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:07.991149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lazy-loading 'fault' on Instance uuid d1af6c57-9173-4fbf-88fd-ca721404f2b3 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:08.033091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:08.040432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4c5cdf6c-153d-46c1-b7ca-fcdf0aa1cd8b tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1303 microversion: 2.1 time: 0.095092 Jul 20 13:49:08.041602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 175/334] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:07 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:08.084047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:08.084684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:08.091172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:08.091649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:08.092440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:08.092875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:08.225339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:08.233911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-09c37b89-d1ae-4234-9fc3-b9ee2b0ee16d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1470 microversion: 2.1 time: 0.153592 Jul 20 13:49:08.234592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 160/335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:08 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:08.292683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:08.293287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:08.299263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:08.299705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:08.300492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:08.300920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:08.439616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:08.447201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d50111a2-2458-44ac-8d1b-29e45526702d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.159094 Jul 20 13:49:08.447763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 176/336] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:08 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:09.057753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:09.058392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:09.064315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:09.064761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:09.065521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:09.065954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:09.098597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:09.099234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:09.099466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lazy-loading 'fault' on Instance uuid d1af6c57-9173-4fbf-88fd-ca721404f2b3 {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:09.138795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e3dacd75e3a47d9bda05d873826c818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a900e75b4437b85994fce6c1e3ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:09.146066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2592739e-6865-48aa-900f-c70cb33607c2 tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 200 len: 1303 microversion: 2.1 time: 0.092252 Jul 20 13:49:09.146619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 161/337] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:09 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:09.251711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:09.252553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:09.258846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:09.259475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:09.260293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:09.260770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:09.467251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:09.468156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:09.474777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:09.475474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:09.476436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:09.477028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:09.515131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:09.528870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-00bcbbdf-d89d-4fc5-bca1-57eaf1b1920b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1470 microversion: 2.1 time: 0.281442 Jul 20 13:49:09.529453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 177/338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:09 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:09.640750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:09.648290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dfb8a784-1eb4-431e-910c-606737c69a6f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.186670 Jul 20 13:49:09.648860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 162/339] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:09 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:10.163205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:10.164169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] [instance: d1af6c57-9173-4fbf-88fd-ca721404f2b3] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:10.173743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:10.174520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:10.175288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:10.175882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:10.191282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] HTTP exception thrown: Instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 could not be found. Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Request method failure captured: Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 HTTP/1.1 Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AeUQNsKW5OmSQHGQPgEZCsnP5jl3SOm8yzCh7YN56Lgm74ZDizR3Jd2sr41yaRrLmUZR6xysH2ufsj7fAuWI6gr5-pzaANH8O3RSdeRb9Up7sdczVLlKaLDqpEm6AiNunIFSi4yo-pkJ_N0UG3-HcOnjKDRhJCsYMXADLcky0JV_JQ Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 937a900e75b4437b85994fce6c1e3ce4 Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesActionsTest-2142449006 Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:49:10.193468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/937a900e75b4437b85994fce6c1e3ce4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_937a900e75b4437b85994fce6c1e3ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/937a900e75b4437b85994fce6c1e3ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/937a900e75b4437b85994fce6c1e3ce4"}]}] Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesActionsTest-2142449006 Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 937a900e75b4437b85994fce6c1e3ce4 Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesActionsTest-2142449006 Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesActionsTest-2142449006-project Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 0e3dacd75e3a47d9bda05d873826c818 Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesActionsTest-2142449006-project Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 could not be found. Jul 20 13:49:10.194704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': 'd1af6c57-9173-4fbf-88fd-ca721404f2b3'} Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 could not be found. Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:49:10.195404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 could not be found. Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 could not be found. Jul 20 13:49:10.196596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:10.199732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] Returning 404 to user: Instance d1af6c57-9173-4fbf-88fd-ca721404f2b3 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:49:10.200850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d86783bc-43f9-4758-95b6-39e298dcd6cc tempest-VolumesActionsTest-2142449006 tempest-VolumesActionsTest-2142449006-project] 10.222.0.17 "GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3" status: 404 len: 111 microversion: 2.1 time: 0.041798 Jul 20 13:49:10.205115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 178/340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:10 2022] GET /compute/v2.1/servers/d1af6c57-9173-4fbf-88fd-ca721404f2b3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:10.547959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:10.549190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:10.555866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:10.556406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:10.557183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:10.557616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:10.634917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:10.644744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4257e7cf-8215-4d30-94d5-78c87c0d2b3f tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1428 microversion: 2.1 time: 0.102164 Jul 20 13:49:10.646927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 163/341] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:10 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:10.667569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:10.668119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:10.677102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:10.677943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:10.679075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:10.679731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:10.853502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-f42197db-e4ec-4734-8599-9e9e0f7dc29f req-bcb437b0-4757-46a2-b9f1-35afdf84fc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd436784-42aa-4eb2-8a32-eda88350ecba", "name": "network-vif-deleted", "tag": "38a7dfaf-cb74-45cf-9519-0686064f97f4"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:10.867234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f42197db-e4ec-4734-8599-9e9e0f7dc29f req-bcb437b0-4757-46a2-b9f1-35afdf84fc33 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:10.868254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f42197db-e4ec-4734-8599-9e9e0f7dc29f req-bcb437b0-4757-46a2-b9f1-35afdf84fc33 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:10.893168 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-f42197db-e4ec-4734-8599-9e9e0f7dc29f req-bcb437b0-4757-46a2-b9f1-35afdf84fc33 service nova] Creating event network-vif-deleted:38a7dfaf-cb74-45cf-9519-0686064f97f4 for instance fd436784-42aa-4eb2-8a32-eda88350ecba on hv-cinder-81914 Jul 20 13:49:10.905537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-f42197db-e4ec-4734-8599-9e9e0f7dc29f req-bcb437b0-4757-46a2-b9f1-35afdf84fc33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058203 Jul 20 13:49:10.906631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 164/342] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:49:11.009971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:11.019603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f7008dbe-5aba-41e2-bdb2-4aebc6066670 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.358013 Jul 20 13:49:11.020384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 179/343] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:10 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:11.201762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5b77b38d-efdc-433f-bf36-bdea994e1d48 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67b9b900-8110-45ab-b3cd-5cd90f906b29"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:11.203478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5b77b38d-efdc-433f-bf36-bdea994e1d48 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:11.210113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b77b38d-efdc-433f-bf36-bdea994e1d48 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:11.210562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b77b38d-efdc-433f-bf36-bdea994e1d48 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:11.211320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b77b38d-efdc-433f-bf36-bdea994e1d48 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:11.211749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b77b38d-efdc-433f-bf36-bdea994e1d48 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:11.286437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:11.663890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:11.664538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:11.670415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:11.670969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:11.671621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:11.672057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:11.703357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:11.703828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:11.704295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lazy-loading 'fault' on Instance uuid fd436784-42aa-4eb2-8a32-eda88350ecba {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:11.746310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:11.754350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5a8de13d-f014-4d30-8ae0-2ce6ccc5ff7e tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1305 microversion: 2.1 time: 0.094231 Jul 20 13:49:11.755066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 180/344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:11 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:12.037243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:12.037850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:12.046978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.047654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.048602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.049150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.417086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:12.426290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bc55b001-d931-4968-925e-0014e0e5bfd0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.392755 Jul 20 13:49:12.428302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 181/345] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:12 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:12.434364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:12.434891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:12.441104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.441551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.442322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.442752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.467281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lazy-loading 'flavor' on Instance uuid 8bf47794-d975-439d-85ed-1a2fd9cbd791 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:12.471208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:12.729431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c2642aed-b871-4338-9c94-4b4f158da9a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/action" status: 202 len: 0 microversion: 2.20 time: 0.298988 Jul 20 13:49:12.730038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 182/346] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 13:49:12 2022] POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:49:12.738031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:12.738717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:12.745536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.745983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.746746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.747178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.873799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:12.881949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:12.883495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:12.884757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a358ce55-6ad5-416d-b938-bfe2d3945e99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.150518 Jul 20 13:49:12.885308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 183/347] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:12.889628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:12.890227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:12.895764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.896237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.897003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.897436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.927730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:12.928179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:12.928649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lazy-loading 'fault' on Instance uuid fd436784-42aa-4eb2-8a32-eda88350ecba {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:12.969643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:12.977137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6d4ef104-cb43-4462-bb85-3027ad4abd8d tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1305 microversion: 2.1 time: 0.090899 Jul 20 13:49:12.977709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 184/348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:12 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:13.445379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:13.445991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:13.452019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:13.452496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:13.453519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:13.453957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:13.594619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:13.602305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cfa3756d-4c50-4658-bc51-e7f620687027 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.160828 Jul 20 13:49:13.602946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 185/349] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:13 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:13.903394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:13.904031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:13.910076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:13.910526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:13.911290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:13.911729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:14.039637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:14.047630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:14.049177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:14.050329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-afd38ce2-ff6a-49c4-833c-791504893d10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.151334 Jul 20 13:49:14.050888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 186/350] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:14.055263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:14.055862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:14.061859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:14.062302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:14.063063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:14.063495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:14.093535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:14.093980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:14.094422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lazy-loading 'fault' on Instance uuid fd436784-42aa-4eb2-8a32-eda88350ecba {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:14.133594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:14.140939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8c638e39-839c-48c6-a37d-bc0079782877 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1305 microversion: 2.1 time: 0.089119 Jul 20 13:49:14.141503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 187/351] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:14 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:14.618859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:14.619559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:14.625897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:14.626351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:14.627131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:14.627566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:14.783943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:14.793646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7e3a6289-5bd0-43fc-8a38-c9618dd0126a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.178626 Jul 20 13:49:14.794211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 188/352] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:14 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:14.848095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5b77b38d-efdc-433f-bf36-bdea994e1d48 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.651001 Jul 20 13:49:14.848899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 165/353] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 13:49:11 2022] POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 194 bytes in 3653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:49:15.069559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:15.070078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:15.076564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:15.077012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:15.078035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:15.078463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:15.158728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:15.159679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:15.165739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:15.166184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:15.166938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:15.167366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:15.203397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:15.203842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:15.204342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lazy-loading 'fault' on Instance uuid fd436784-42aa-4eb2-8a32-eda88350ecba {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:15.215891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:15.224911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:15.226616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:15.227951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7cb001a3-706a-4887-987d-138ee922d7b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.162902 Jul 20 13:49:15.238246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 189/354] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:15.247545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3283bab75b9b47a9924eb68fd8ae7bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96512fcc7c47e8a3a572318630be2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:15.256628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-911a317d-3f3e-4f64-8074-93ff2c465b1b tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 200 len: 1305 microversion: 2.1 time: 0.101980 Jul 20 13:49:15.257232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 166/355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:15 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:15.810297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:15.811060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:15.817431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:15.817854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:15.818617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:15.819051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:15.958110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:15.965828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5c678638-9a2c-41ea-a039-74088661ddf4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.159349 Jul 20 13:49:15.966388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 190/356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:15 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:16.248322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:16.248979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:16.256852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:16.257347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:16.258329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:16.258817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:16.274136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:16.274717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] [instance: fd436784-42aa-4eb2-8a32-eda88350ecba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:16.281694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:16.282142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:16.282906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:16.283567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:16.308626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] HTTP exception thrown: Instance fd436784-42aa-4eb2-8a32-eda88350ecba could not be found. Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Request method failure captured: Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba HTTP/1.1 Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2Ae5DXnNsMvS22ciR7k7K6x_4nspV5rBD-E0eV522Z_b7zKbGbYY1Jdg6qU7FLoB1VLmgAdoGqcDZeISzLtH3SYek3rltqjyGYkKzkZAHJMxakt8Nmm8t-dDaz6HU5Ws9p7AhQ-tBCcw7Q6gnfYl46ymGhdiLhUpkJN9GknNnCvbh-E Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: ce96512fcc7c47e8a3a572318630be2b Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesNegativeTest-1197840621 Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:49:16.310485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ce96512fcc7c47e8a3a572318630be2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ce96512fcc7c47e8a3a572318630be2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce96512fcc7c47e8a3a572318630be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce96512fcc7c47e8a3a572318630be2b"}]}] Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesNegativeTest-1197840621 Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: ce96512fcc7c47e8a3a572318630be2b Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesNegativeTest-1197840621 Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesNegativeTest-1197840621-project Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 3283bab75b9b47a9924eb68fd8ae7bc1 Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesNegativeTest-1197840621-project Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance fd436784-42aa-4eb2-8a32-eda88350ecba could not be found. Jul 20 13:49:16.312156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': 'fd436784-42aa-4eb2-8a32-eda88350ecba'} Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd436784-42aa-4eb2-8a32-eda88350ecba could not be found. Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:49:16.313117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd436784-42aa-4eb2-8a32-eda88350ecba could not be found. Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd436784-42aa-4eb2-8a32-eda88350ecba could not be found. Jul 20 13:49:16.314324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:49:16.315450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] Returning 404 to user: Instance fd436784-42aa-4eb2-8a32-eda88350ecba could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:49:16.315450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f5967d93-7ed7-494d-94f4-f87321f96f68 tempest-VolumesNegativeTest-1197840621 tempest-VolumesNegativeTest-1197840621-project] 10.222.0.17 "GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba" status: 404 len: 111 microversion: 2.1 time: 0.041849 Jul 20 13:49:16.315450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 191/357] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:16 2022] GET /compute/v2.1/servers/fd436784-42aa-4eb2-8a32-eda88350ecba => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:16.419946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:16.429580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:16.431639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:16.435039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61e70afd-009d-4751-8211-7502ebefe07a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.188965 Jul 20 13:49:16.435628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 167/358] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:16.871064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c964dfe9-c728-4168-8ed7-332115044a51 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aaf1de8-1b50-43c5-a9c8-55fa24fd9473", "device": "/dev/sdb"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:16.875375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c964dfe9-c728-4168-8ed7-332115044a51 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:16.893347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c964dfe9-c728-4168-8ed7-332115044a51 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:16.895998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c964dfe9-c728-4168-8ed7-332115044a51 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:16.897861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c964dfe9-c728-4168-8ed7-332115044a51 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:16.898883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c964dfe9-c728-4168-8ed7-332115044a51 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:16.985280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:16.985896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:16.998198 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:16.999209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:17.000220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:17.001749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:17.170920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:17.178718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-495daed6-9fe3-41fb-9510-66a417885452 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.198960 Jul 20 13:49:17.179358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 168/359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:16 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:17.454227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:17.454924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:17.461034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:17.461486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:17.462888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:17.463540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:17.622635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:17.665450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:17.669793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:17.671903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5e0eaeeb-4afa-4c54-ab96-f7481311b333 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.222059 Jul 20 13:49:17.672784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 169/360] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:18.195833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:18.196983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:18.203686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:18.204140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:18.204931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:18.205477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:18.342132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:18.351807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-452c6af2-b9fd-4455-a641-830299a7291a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.158203 Jul 20 13:49:18.352492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 170/361] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:18 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:18.692026 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:18.692781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:18.700682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:18.701132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:18.702750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:18.703337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:18.845275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:18.854186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:18.855984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:18.857416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3a600231-6f86-425b-9395-6cd883816cbc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.170629 Jul 20 13:49:18.857998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 171/362] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:19.370190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:19.371131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:19.377535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:19.378421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:19.379296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:19.379821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:19.518021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:19.525683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2402125f-7051-4308-a0ff-009cd811bf36 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.160065 Jul 20 13:49:19.526243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 172/363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:19 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:19.879589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:19.880318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:19.888306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:19.889213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:19.890247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:19.890936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:20.051737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:20.065364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:20.067265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:20.069353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-806796b1-3904-4666-a614-be63583e56ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.193497 Jul 20 13:49:20.069935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 173/364] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:20.105322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c964dfe9-c728-4168-8ed7-332115044a51 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "POST /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.245398 Jul 20 13:49:20.106102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 192/365] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 13:49:16 2022] POST /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160/os-volume_attachments => generated 194 bytes in 3247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:49:20.545902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:20.546791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:20.556001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:20.556719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:20.557938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:20.558746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:20.706222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:20.715920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-91146751-89e9-486f-a45c-659e6c83eebc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.176147 Jul 20 13:49:20.716762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 174/366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:20 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:21.090613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:21.091313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:21.102286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:21.103464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:21.104476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:21.105216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:21.270740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:21.281887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:21.283541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:21.284739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ca41a68c-936c-416e-a98d-d308288c0b93 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.199020 Jul 20 13:49:21.285284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 193/367] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:21.734230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:21.735073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:21.743664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:21.744618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:21.745679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:21.746115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:21.896644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:21.904420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7a516c6f-1bcc-40b5-8c14-9a7663718dc6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.174634 Jul 20 13:49:21.905228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 175/368] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:21 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:22.308810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:22.309589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:22.320003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:22.320758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:22.323791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:22.324513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:22.487007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:22.496602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:22.498482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:22.499728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e7c36faa-5f7c-4e0a-acb6-9fa7d87ce492 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.196063 Jul 20 13:49:22.500312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 194/369] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:22.922317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:22.922948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:22.930236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:22.930684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:22.931564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:22.932054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:23.072684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:23.080423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-020df292-b2f8-4ae7-b7ae-57c1abb7faec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.162068 Jul 20 13:49:23.081075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 176/370] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:22 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:23.519918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:23.521766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:23.532915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:23.535302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:23.536793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:23.537243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:23.703896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:23.717263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:23.718978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:23.720667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ba5fcde1-6724-4056-83ad-521712e09357 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.206045 Jul 20 13:49:23.721456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 195/371] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:24.096530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:24.097744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:24.104861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:24.105311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:24.106199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:24.106808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:24.267760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:24.280967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-944ff521-cad8-41a9-a68f-bd4015b9c662 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.186147 Jul 20 13:49:24.291854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 177/372] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:24 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:24.740961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:24.741785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:24.748452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:24.749305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:24.750264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:24.750909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:24.770228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:24.903488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:24.921721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:24.924437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:24.925868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8fb8d8f5-ab04-42ce-88b9-f653e33a4e68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.188938 Jul 20 13:49:24.926891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 196/373] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:25.298718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:25.299327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:25.305658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:25.306106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:25.306873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:25.307307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:25.448423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:25.457360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f8256052-16c3-449e-af50-78c970145536 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.162438 Jul 20 13:49:25.457949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 178/374] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:25 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:25.683397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d084507f-8e15-4ac2-a346-2cc108976878 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:25.689905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d084507f-8e15-4ac2-a346-2cc108976878 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:25.690355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d084507f-8e15-4ac2-a346-2cc108976878 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:25.753183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d084507f-8e15-4ac2-a346-2cc108976878 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Going to try to stop instance {{(pid=129541) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 13:49:25.799522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d084507f-8e15-4ac2-a346-2cc108976878 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/action" status: 202 len: 0 microversion: 2.1 time: 0.120991 Jul 20 13:49:25.800126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 197/375] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 13:49:25 2022] POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:49:25.808999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:25.810257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:25.816804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:25.817478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:25.818396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:25.819071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:25.944315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:25.945397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:25.953185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:25.953911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:25.955018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:25.955652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:25.989840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:26.014759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d1f0c0ae-ec4e-4197-bdf7-b53954535403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.210304 Jul 20 13:49:26.015547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 179/376] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:26.105081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:26.113032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:26.114515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:26.115644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6741707d-d69d-4ec4-87b7-530cc4eb8741 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.175555 Jul 20 13:49:26.116213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 198/377] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:26.474807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:26.475380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:26.482710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:26.483180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:26.484105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:26.484438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:26.681290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:26.687826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:26.691602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-77343778-5790-4ac7-a603-d156a44b292d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.219650 Jul 20 13:49:26.692673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 180/378] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:26 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:27.033517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:27.034152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:27.042708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:27.043489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:27.044532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:27.045171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:27.135146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:27.136108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:27.154487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:27.155276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:27.156149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:27.156695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:27.227460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:27.236501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-904777fe-10a4-46b8-9f08-6d2175580961 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.207461 Jul 20 13:49:27.237339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 199/379] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:27.349663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:27.358954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:27.360542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:27.361735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-69ebc3c5-0b6d-470b-8afe-baa1efc6b21f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.231787 Jul 20 13:49:27.362491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 181/380] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:27.709329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:27.710025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:27.718012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:27.718012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:27.718822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:27.719438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:27.894700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:27.912604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a44acab2-5a3a-498a-9c70-b0b03ec864cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.206435 Jul 20 13:49:27.925351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 200/381] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:27 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:28.253312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:28.254572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:28.261888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:28.262328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:28.263087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:28.263509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:28.383344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:28.384544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:28.390619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:28.392511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:28.393391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:28.393824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:28.399473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:28.408615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aa5c6ac1-0b92-4020-b75c-26f354fcac8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.159117 Jul 20 13:49:28.409182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 182/382] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:28.551931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:28.560852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:28.562512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:28.563764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9e8efcbc-cf72-45ab-a0b0-c65336ecbb8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.184543 Jul 20 13:49:28.564346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 201/383] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:28.933080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:28.933693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:28.940199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:28.940676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:28.941469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:28.942118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:29.091689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:29.101169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-625a1271-2d34-4f6f-beba-38ac22d73822 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.172516 Jul 20 13:49:29.102235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 183/384] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:28 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:29.433258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:29.434794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:29.441642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:29.442241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:29.443153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:29.443685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:29.583426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:29.584164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:29.596226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:29.597737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:29.601753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:29.602500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:29.610946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:29.621677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6fa77e5f-805a-4547-b274-460044545011 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.193218 Jul 20 13:49:29.622250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 202/385] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:29.807553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:29.818699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:29.820762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:29.822551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f1870ea7-92ef-4286-847a-85954ca1813c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.243583 Jul 20 13:49:29.835126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 184/386] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:30.119622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:30.120145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:30.129448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:30.130087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:30.130893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:30.131332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:30.288844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:30.298034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-23e44d09-f596-4232-b319-f1db3d7e57ff tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.183182 Jul 20 13:49:30.298816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 203/387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:30 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:30.638621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:30.640465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:30.647692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:30.648299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:30.649694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:30.650355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:30.816787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:30.826787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-91d510a6-faab-43d9-b331-de7d5bffacda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.192968 Jul 20 13:49:30.836608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 185/388] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:30.842331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:30.843249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:30.850864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:30.851317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:30.852138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:30.852791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:31.002719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:31.011625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:31.013162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:31.014637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-73c66e89-e8c1-4ef5-a44a-885da2f2deaf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.176197 Jul 20 13:49:31.015193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 204/389] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:31.316167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:31.317232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:31.324549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:31.324998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:31.325773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:31.326237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:31.463514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:31.471016 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f9d4ff46-f114-4b18-a5da-4451e0b689c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.159487 Jul 20 13:49:31.471576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 186/390] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:31 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:31.844542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:31.852114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:31.858422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:31.863623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:31.864078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:31.864883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:31.872291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:32.033634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:32.034269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:32.047125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:32.047803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:32.056342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:32.060324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:32.105364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:32.115324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-66df8d2b-b6bd-447b-a3c1-396f93b13f0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.274636 Jul 20 13:49:32.126571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 205/391] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:32.253880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:32.263161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:32.264786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:32.266296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-85893db9-d48e-44fe-a701-af75cf3b7f57 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.236544 Jul 20 13:49:32.266857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 187/392] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:32.487629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:32.488486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:32.495262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:32.495898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:32.496703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:32.497136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:32.663624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:32.671909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e5c004f6-81a8-4931-867d-b242fcd13633 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.188823 Jul 20 13:49:32.672531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 206/393] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:32 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:33.133310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:33.133944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:33.140794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:33.141438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:33.142413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:33.142847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:33.307052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:33.312433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:33.329098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:33.341901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:33.342062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d5443fdc-2a80-4020-a5a5-2195ec547738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.212642 Jul 20 13:49:33.344007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:33.347041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:33.347925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:33.352656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 188/394] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:33.579846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:33.589743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:33.591931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:33.594017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3401c104-7dc1-4a65-bf33-58d9bafac208 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.309284 Jul 20 13:49:33.595661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 207/395] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:33.689953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:33.690554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:33.697524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:33.697969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:33.698986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:33.699339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:33.844316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:33.854027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ee7e8c04-f631-41e6-ad32-b4f201911709 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.167802 Jul 20 13:49:33.854593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 189/396] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:33 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:34.371293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:34.372961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:34.398584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:34.399083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:34.399881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:34.400580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:34.560049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:34.569063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c7757e58-b637-4fcd-b554-6be6c1c8469c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.213300 Jul 20 13:49:34.570115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 208/397] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:34.613258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:34.614667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:34.621971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:34.622811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:34.623905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:34.624368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:34.790274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:34.799046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:34.800619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:34.801931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8aa82978-0340-43eb-8353-d416d91be917 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.193016 Jul 20 13:49:34.808230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 190/398] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:34.874474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:34.875982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:34.887907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:34.888649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:34.889909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:34.890631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:35.071634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:35.079933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9dbecdf2-8f36-41c8-88fd-fbcf03cbf917 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.209456 Jul 20 13:49:35.080542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 209/399] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:34 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:35.588436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:35.589043 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:35.597959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:35.598697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:35.600120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:35.601560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:35.749608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:35.758085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-97f9c7fa-8f75-410c-8884-c511251271e9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.175105 Jul 20 13:49:35.759866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 191/400] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:35.822692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:35.823598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:35.830452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:35.831111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:35.831895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:35.832367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:35.983083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:35.997945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:35.999781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:36.001245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fcbcca59-c5ce-4170-9f52-6ad2e9727e31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.183137 Jul 20 13:49:36.001906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 210/401] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:36.100544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:36.101590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:36.104650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=80 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:36.110007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:36.110463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:36.111242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:36.111905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:36.248003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:36.255998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89a7eba8-c70f-469a-a4b9-4040f0ea4df2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.162291 Jul 20 13:49:36.256628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 192/402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:36 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:36.775875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:36.776500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:36.782817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:36.783455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:36.784511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:36.785089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:36.921331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:36.924956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:36.930834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a7e52e12-1f72-454a-a7b4-2a2ef226cbc7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.158279 Jul 20 13:49:36.931435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 211/403] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:37.022905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:37.024815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:37.037461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:37.038115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:37.042148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:37.042607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:37.192896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:37.202070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:37.203885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:37.205103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-44a2612c-5bd4-475d-97f5-13d918ef9f68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.186333 Jul 20 13:49:37.205731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 193/404] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:37.274641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:37.275232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:37.281659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:37.282101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:37.282855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:37.283283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:37.451398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:37.459847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e2d692a3-4786-4c05-81e7-2c47625c4035 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.189518 Jul 20 13:49:37.460463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 212/405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:37 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:37.948852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:37.949725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:37.956483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:37.957021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:37.957884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:37.958393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:38.103330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:38.111913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-91f18bda-f451-46aa-9c22-c3f24dc1f173 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.167794 Jul 20 13:49:38.112520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 194/406] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:38.222941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:38.223550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:38.231049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:38.231534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:38.232334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:38.232768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:38.362794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:38.370812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:38.372393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:38.373542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-967e8086-b10a-48a2-9f75-07ab8c155d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.154550 Jul 20 13:49:38.374100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 213/407] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:38.477391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:38.477945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:38.484036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:38.484538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:38.485305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:38.485737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:38.616173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:38.624064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fbcd0c4c-32ce-4266-8cb2-2e1ae52ac506 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.150609 Jul 20 13:49:38.624659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 195/408] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:38 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:39.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:39.130121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:39.136824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:39.137526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:39.138344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:39.139125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:39.290246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:39.298421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c94b57ad-2428-4610-b2ca-d58a99dadf82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.172900 Jul 20 13:49:39.299119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 214/409] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:39.391007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:39.391725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:39.404924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:39.406201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:39.407932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:39.409904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:39.581647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:39.589891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:39.591468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:39.592746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-03a299e3-b356-4797-a83d-01a2d4450ede tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1723 microversion: 2.20 time: 0.205593 Jul 20 13:49:39.593347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 196/410] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:39.641722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:39.642332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:39.651984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:39.652466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:39.653246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:39.654133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:39.809524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:39.818234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2dcacd98-c1c6-449c-9435-0dc9b111c458 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.180293 Jul 20 13:49:39.818986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 215/411] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:39 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:40.315908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:40.316548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:40.322557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:40.323038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:40.323802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:40.324262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:40.338976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:40.462195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:40.470660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a69b2807-80f4-4ace-bd43-745b2853edbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.158511 Jul 20 13:49:40.471244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 197/412] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:40.610693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:40.611321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:40.618178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:40.618630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:40.619406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:40.619849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:40.760359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:40.768867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:40.775760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:40.777071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9e898dc6-a1a8-4434-b715-fab40ff2b3a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1744 microversion: 2.20 time: 0.170278 Jul 20 13:49:40.777670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 216/413] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:40.836316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:40.836926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:40.843358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:40.843805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:40.844600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:40.845034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:41.059346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:41.067320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-026c7302-a4e3-4da5-b815-afbde089e01a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.235063 Jul 20 13:49:41.068011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 198/414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:40 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:41.488069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:41.488795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:41.500032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:41.501007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:41.501372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:41.501985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:41.658447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:41.666890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-013c5c63-a186-4cc4-9d61-b6eb45359925 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.182723 Jul 20 13:49:41.667455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 217/415] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:41.795355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:41.795996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:41.802365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:41.802816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:41.805571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:41.806824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:41.965766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:41.974461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:41.976094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:41.977540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-32a7180b-9dad-4ed6-8ca2-68f43ed8dee0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1744 microversion: 2.20 time: 0.186012 Jul 20 13:49:41.978197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 199/416] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:42.084633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:42.085842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:42.092003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:42.092483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:42.093244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:42.093673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:42.229695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:42.237602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6b4b5821-3a7a-4f21-9224-116f7bc38538 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.156839 Jul 20 13:49:42.238201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 218/417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:42 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:42.684386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:42.685495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:42.690986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:42.691428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:42.692184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:42.692635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:42.818202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:42.826283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c77d8994-ff5b-477a-b57d-318b8f291fbc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.146317 Jul 20 13:49:42.826850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 200/418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:42.997183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:42.997793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:43.004207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:43.004663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:43.005425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:43.005855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:43.150953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:43.159660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:43.161193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:43.162345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-89c45c61-5421-49cc-a780-59ce1bb83d80 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1744 microversion: 2.20 time: 0.169711 Jul 20 13:49:43.164251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 219/419] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:43.257325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:43.258459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:43.264558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:43.265006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:43.265773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:43.266205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:43.416219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:43.426048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f3502093-c3c1-4af6-bb02-83c882b8d03b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.172544 Jul 20 13:49:43.427118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 201/420] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:43 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:43.844205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:43.844817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:43.850746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:43.851193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:43.852024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:43.852476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:43.979694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:43.988532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-885deedd-9b7d-4e4e-940a-6876c014536f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.148043 Jul 20 13:49:43.989096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 220/421] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:44.181341 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:44.182016 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:44.188344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:44.188785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:44.189979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:44.189979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:44.320620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:44.328943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:44.330530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:44.331677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-120673a0-8564-4268-a8be-3bf38eee39cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1744 microversion: 2.20 time: 0.154583 Jul 20 13:49:44.332266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 202/422] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:44.443970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:44.444607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:44.451969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:44.452708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:44.453540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:44.453973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:44.582561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:44.590702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a7cd51ac-7e04-4a80-95a7-32348ddac807 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.150688 Jul 20 13:49:44.591290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 221/423] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:44 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:45.010126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:45.010947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:45.021428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.021960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.022882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.023396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.181996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:45.191369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-084e244b-bcd4-4aad-90a1-a8480148f8c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1724 microversion: 2.1 time: 0.188378 Jul 20 13:49:45.192220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 203/424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:45.274572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-abd5ca1f-6a11-42ee-a760-b79961fd0994 req-2740164a-ac79-4718-b021-e95def4f2344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "name": "network-vif-plugged", "status": "completed", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:45.284038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-abd5ca1f-6a11-42ee-a760-b79961fd0994 req-2740164a-ac79-4718-b021-e95def4f2344 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.284518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-abd5ca1f-6a11-42ee-a760-b79961fd0994 req-2740164a-ac79-4718-b021-e95def4f2344 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.295562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-abd5ca1f-6a11-42ee-a760-b79961fd0994 req-2740164a-ac79-4718-b021-e95def4f2344 service nova] Creating event network-vif-plugged:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 13:49:45.300489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-abd5ca1f-6a11-42ee-a760-b79961fd0994 req-2740164a-ac79-4718-b021-e95def4f2344 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029655 Jul 20 13:49:45.301073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 222/425] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:49:45.351710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:45.352552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:45.360091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.360672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.361530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.362059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.491202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:45.499659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:45.501201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:45.502355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-24617a3c-5825-4dd8-8f07-ebea586f939c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1744 microversion: 2.20 time: 0.155130 Jul 20 13:49:45.502904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 204/426] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:45.609032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:45.609701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:45.615803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.616349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.617113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.618159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.755559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:45.763833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-03e4ea13-1a4d-4eaf-b79c-98ba233db3ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1502 microversion: 2.1 time: 0.159449 Jul 20 13:49:45.764669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 223/427] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:45 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:45.782785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d761b8f-a42a-49ae-903c-12352ef6017d"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:45.783916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:45.790568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.791008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.791761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.792210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.815209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] HTTP exception thrown: Cannot 'attach_volume' instance 52fcfee5-9168-4461-8523-7471fd8e81e5 while it is in vm_state rescued Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Request method failure captured: Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: POST /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5/os-volume_attachments HTTP/1.1 Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 74 Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdeirwC7UAYHUaPvCX0p4USyk_j0fsKkFCkvXzUZGvKTZhYw5K34ULuvN4sqXQEAOymvW7JfYWpJ7W9WautsqwdIA61j5aeKpNa63UbPFVwPl38o2F0NkOMJriYpp0Th9TILBFdJCWsD2aV3BCG4efbxsq_gQAjvFwNKUg1TG_pxrE Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 4d8105a57b2a47d5851fc8ca3d13c9e3 Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:49:45.817125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}] Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 4d8105a57b2a47d5851fc8ca3d13c9e3 Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-ServerRescueNegativeTestJSON-1442909024-project Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: 7c1d0edb03914ac69ebdb833ee1c2d75 Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442909024-project Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {"volumeAttachment": {"volumeId": "7d761b8f-a42a-49ae-903c-12352ef6017d"}} Jul 20 13:49:45.819224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Cannot 'attach_volume' instance 52fcfee5-9168-4461-8523-7471fd8e81e5 while it is in vm_state rescued Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'server_id': '52fcfee5-9168-4461-8523-7471fd8e81e5', 'body': {'volumeAttachment': {'volumeId': '7d761b8f-a42a-49ae-903c-12352ef6017d'}}} Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52fcfee5-9168-4461-8523-7471fd8e81e5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:49:45.820436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 52fcfee5-9168-4461-8523-7471fd8e81e5 while it is in vm_state rescued Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:49:45.821785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:49:45.823183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:49:45.823183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:49:45.823183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 52fcfee5-9168-4461-8523-7471fd8e81e5 while it is in vm_state rescued Jul 20 13:49:45.823183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:49:45.823183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Returning 409 to user: Cannot 'attach_volume' instance 52fcfee5-9168-4461-8523-7471fd8e81e5 while it is in vm_state rescued {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:49:45.823183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-27447c34-d5f4-41ea-b18e-8503bb965592 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039742 Jul 20 13:49:45.823183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 205/428] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 13:49:45 2022] POST /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 13:49:45.827950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe240eea-c76d-40ff-8d5e-aacf91000c61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:45.828501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe240eea-c76d-40ff-8d5e-aacf91000c61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:45.834438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe240eea-c76d-40ff-8d5e-aacf91000c61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.834881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe240eea-c76d-40ff-8d5e-aacf91000c61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.835636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe240eea-c76d-40ff-8d5e-aacf91000c61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.836767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe240eea-c76d-40ff-8d5e-aacf91000c61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.902009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe240eea-c76d-40ff-8d5e-aacf91000c61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5/action" status: 202 len: 0 microversion: 2.1 time: 0.077996 Jul 20 13:49:45.903015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 224/429] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 13:49:45 2022] POST /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 13:49:45.911453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:45.912090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:45.918601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.919205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:45.920169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:45.920788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.058373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:46.066335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ccfb365b-0284-4586-af69-c55fbe6a414d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.158977 Jul 20 13:49:46.066920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 206/430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:45 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:46.209556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:46.210275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:46.217081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:46.217525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.218290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:46.218722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.354084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:46.363814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-659280ce-54a4-40a5-b9eb-86db06d2d006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1701 microversion: 2.1 time: 0.158472 Jul 20 13:49:46.376527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 225/431] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1701 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:46.381530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e120b089-ff11-4a2b-a36c-f388886ceb39 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:46.388762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e120b089-ff11-4a2b-a36c-f388886ceb39 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:46.389287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e120b089-ff11-4a2b-a36c-f388886ceb39 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.449830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e120b089-ff11-4a2b-a36c-f388886ceb39 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Going to try to start instance {{(pid=129542) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 13:49:46.496871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e120b089-ff11-4a2b-a36c-f388886ceb39 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/action" status: 202 len: 0 microversion: 2.1 time: 0.118997 Jul 20 13:49:46.497676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 207/432] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 13:49:46 2022] POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:49:46.505632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:46.506245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:46.513071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:46.513514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.514313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:46.514739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.522386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:46.523340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:46.533171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:46.533622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.534423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:46.534922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:46.675083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:46.685691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ab7cf405-0ebe-4986-9718-df73e8c5bd72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1710 microversion: 2.1 time: 0.183794 Jul 20 13:49:46.686450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 226/433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1710 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:46.703992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:46.713026 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:46.714664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:46.715882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ba43646e-ab20-437e-9c55-c5ab90439082 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1744 microversion: 2.20 time: 0.199133 Jul 20 13:49:46.716570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 208/434] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1744 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:47.084444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:47.085075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:47.091633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:47.092077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:47.092871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:47.093298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:47.227221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:47.234800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c98cdeb1-5e22-436d-a96e-1a0e6b25935d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.154373 Jul 20 13:49:47.235448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 227/435] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:47 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:47.703586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:47.704153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:47.710320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:47.710767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:47.712119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:47.712583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:47.735417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:47.736029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:47.742030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:47.743044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:47.744035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:47.744499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:47.748836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:47.865506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:47.874459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-585f9407-76bd-48df-9be2-014f2bc3b0d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1710 microversion: 2.1 time: 0.175190 Jul 20 13:49:47.875055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 209/436] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1710 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:47.944862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:47.954089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:47.955750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:47.956934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2450f594-b7b3-4df1-b139-c318a584af0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1744 microversion: 2.20 time: 0.225534 Jul 20 13:49:47.957502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 228/437] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:48.253706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:48.254809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:48.263255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:48.264008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:48.265332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:48.265996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:48.709991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:48.720490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d31d966c-6ad4-45f3-94d9-278481fb3020 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.472157 Jul 20 13:49:48.721081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 210/438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:48 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:48.893014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:48.893632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:48.904548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:48.905072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:48.905888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:48.906324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:48.984017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:48.984669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:48.991204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:48.992657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:48.994168 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:48.994769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:49.266020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:49.287324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-651e9d16-105a-43d9-8b95-3a088bb5c8fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1710 microversion: 2.1 time: 0.398091 Jul 20 13:49:49.295493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 229/439] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1710 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:49.364869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:49.374736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:49.376964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:49.380031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-36ab63e6-6939-486b-a8b0-d4e4642e18a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.403817 Jul 20 13:49:49.393219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 211/440] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:49.740647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:49.741924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:49.752672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:49.753636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:49.754860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:49.755532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:49.925351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:49.934259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fd48451e-f7b1-4378-9bf1-a1644f48b8db tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.197621 Jul 20 13:49:49.934729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 230/441] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:49 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:50.306607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:50.307213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:50.317967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:50.318701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:50.320023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:50.322316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:50.399993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:50.400769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:50.412977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:50.419777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:50.421570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:50.422351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:50.621637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:50.641005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:50.642705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:50.644053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d697bd39-b037-4c74-b036-13c41ba58f1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.248648 Jul 20 13:49:50.644978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 231/442] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:50.662025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:50.675545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cf1b9cc6-9e48-43dc-9fe2-bb29d935f680 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1710 microversion: 2.1 time: 0.373624 Jul 20 13:49:50.679034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 212/443] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1710 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:50.954495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:50.956316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:50.974058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:50.974513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:50.975298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:50.975737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:51.242123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:51.266152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f632a8dc-89c9-4e9b-af86-bc26f18ec166 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.317730 Jul 20 13:49:51.270107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 232/444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:50 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:51.662699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:51.664586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:51.674984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:51.675444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:51.676224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:51.676668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:51.694232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:51.695267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:51.704422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:51.708507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:51.709303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:51.710339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:51.711502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:51.902249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:51.913441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:51.916515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:51.918454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e3400c8f-f4a8-4e10-8958-6e7686a8c5db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.259752 Jul 20 13:49:51.920266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 213/445] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:52.009479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:52.025905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f479d7c4-7295-4a0e-b4bb-65a7072e0652 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1710 microversion: 2.1 time: 0.334469 Jul 20 13:49:52.026516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 233/446] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1710 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:49:52.285171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:52.286063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:52.306383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:52.307721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:52.309144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:52.309748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:52.579101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:52.590395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eb545782-09cb-4031-adb5-e1669dddb60e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.309276 Jul 20 13:49:52.602369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 214/447] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:52 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:52.948149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:52.950928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:52.977307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:52.978143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:52.979337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:52.980021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:53.046088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:53.046745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:53.090712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:53.091162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:53.091938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:53.092396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:53.268094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:53.282497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cd5fa11b-527a-4b8a-bda4-59728fc10685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1710 microversion: 2.1 time: 0.242114 Jul 20 13:49:53.283391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 215/448] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1710 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:53.299198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:53.312667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:53.314269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:53.315695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cbd30f90-8661-45f1-bccb-800f1e9f1d42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.374616 Jul 20 13:49:53.326986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 234/449] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:53.609393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:53.610512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:53.619926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:53.620897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:53.622533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:53.623333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:53.876075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:53.893564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6a65e23c-563e-463e-a8ff-b13a60e79d00 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.287102 Jul 20 13:49:53.896569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 216/450] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:53 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:54.300603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:54.301451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:54.314087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:54.314865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:54.316441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:54.317160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:54.336019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:54.337286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:54.349463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:54.350589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:54.352725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:54.354156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:54.584889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:54.597749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1d51f25e-2ce4-4f65-af4d-1bc2f5101a99 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1714 microversion: 2.1 time: 0.301334 Jul 20 13:49:54.599662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 235/451] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1714 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:54.610743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:54.622313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:54.624319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:54.626210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-620a2cb2-f4ea-4941-93da-a1f8778871c1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.295291 Jul 20 13:49:54.643599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 217/452] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:49:54.914248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:54.915206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:54.928487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:54.929005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:54.929959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:54.930456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:55.403098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:55.430492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-44bed4b6-3110-471e-aaa8-3a4062aeeac8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1510 microversion: 2.1 time: 0.520759 Jul 20 13:49:55.433950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 236/453] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:54 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:55.648555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:55.648555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:55.652118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:55.666931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:55.667821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:55.668298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:55.934864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:55.945698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:55.947503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:55.948956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-37d596b2-3457-4c69-873d-d581d816acf8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.307705 Jul 20 13:49:55.950015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 218/454] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:56.453775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:56.457425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:56.467382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:56.469662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:56.470828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:56.475014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:56.970227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:56.970833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:56.990974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:56.991345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:56.992697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:56.996684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:57.089934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:57.098205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1f9c168a-1c81-46c6-b416-8f9318c2dadc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1516 microversion: 2.1 time: 0.651592 Jul 20 13:49:57.102594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 237/455] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:49:56 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1516 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:49:57.427337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:57.428127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:57.440786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:57.441686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:57.442895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:57.443484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:57.469892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:57.485645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:57.487929 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:57.494305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4c5d00b4-be19-4d49-bd81-dcc4c57d6e3e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.529369 Jul 20 13:49:57.495159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 219/456] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:57.855035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lazy-loading 'services' on Instance uuid 18a941e2-485c-40b8-9a3a-10cbfcd13160 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:49:58.184758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e870320b-9225-4456-a1cc-07ce10cef726 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160/os-volume_attachments/9aaf1de8-1b50-43c5-a9c8-55fa24fd9473" status: 202 len: 0 microversion: 2.1 time: 0.779250 Jul 20 13:49:58.189982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 238/457] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 13:49:57 2022] DELETE /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160/os-volume_attachments/9aaf1de8-1b50-43c5-a9c8-55fa24fd9473 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:49:58.513086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:58.514350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:58.527862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:58.528359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:58.529164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:58.533109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:58.847935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:58.865080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:58.871828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:49:58.874057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3e21c02e-489d-4f8a-8554-0e82e59455bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.365904 Jul 20 13:49:58.875193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 220/458] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:49:58.964988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a6da5ea5-171f-4d4f-a97b-4f7cd5b18fe9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'create', calling method: .version_select at 0x7fa40d4a43a0>, body: {"keypair": {"name": "tempest-keypair-878887560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPaA6LHrgLacDHqUlMbWYhDUvUqepbTMHEt8K2YFStfriNAHrawYDdzwc35YwsTo460G5E7xlS6NirGpmayA3fgHDfCa8IhqGbyNOXxws+s65jIiZKYDRpRAn2HN///Bg=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:49:59.002277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-a6da5ea5-171f-4d4f-a97b-4f7cd5b18fe9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:49:59.011332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-a6da5ea5-171f-4d4f-a97b-4f7cd5b18fe9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for user 7c1d0edb03914ac69ebdb833ee1c2d75 and project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:49:59.099706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a6da5ea5-171f-4d4f-a97b-4f7cd5b18fe9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142125 Jul 20 13:49:59.102075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 239/459] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 13:49:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:49:59.893726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:49:59.895552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:49:59.906684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:59.911963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:49:59.915325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:49:59.918529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:00.640726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:00.641342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:00.655130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:00.661400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:00.664126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:00.664869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:00.727528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:00.739192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:00.741013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:00.744283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0090de4b-0646-499b-9e43-6452cfbd2b5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.855721 Jul 20 13:50:00.753587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 221/460] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:49:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:00.757001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 13:50:00.932868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cdc8c47e-fd0f-4ada-98db-37af9a207bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 204 len: 0 microversion: 2.1 time: 0.296242 Jul 20 13:50:00.933463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 240/461] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:50:00 2022] DELETE /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:50:00.941798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:00.943089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:00.958266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:00.958694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:00.959718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:00.960512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:01.572077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:01.597195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c444a9ab-c1c5-4772-94b5-89830b4a8a94 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1515 microversion: 2.1 time: 0.652380 Jul 20 13:50:01.599665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 222/462] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:00 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1515 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:01.775775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:01.776679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:01.793949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:01.795487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:01.796457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:01.796915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:01.930725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1180035825", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71fe8e05-3455-4a93-b609-45dfcc2a72ff"}], "security_groups": [{"name": "tempest-securitygroup--1914615750"}], "key_name": "tempest-keypair-878887560", "user_data": "}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:02.067066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:02.079174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:02.084752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:02.087157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-521016d1-e493-4144-b675-f89172f5edc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.320664 Jul 20 13:50:02.087741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 241/463] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:02.103149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] validate_networks() for [('71fe8e05-3455-4a93-b609-45dfcc2a72ff', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:50:02.614995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:02.617411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:02.619909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:02.641335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:02.642840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:02.647337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:02.648135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:02.927701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:02.936421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6a3adcf2-f1f0-4014-a564-1f47aba17a66 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1515 microversion: 2.1 time: 0.325294 Jul 20 13:50:02.938757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 242/464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:02 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:03.009348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:50:03.010050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:50:03.013018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:50:03.013663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:50:03.014423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:50:03.025441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:03.026223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:03.027267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:03.027945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:03.056477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:50:03.065705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Getting quotas for user 7c1d0edb03914ac69ebdb833ee1c2d75 and project 4d8105a57b2a47d5851fc8ca3d13c9e3. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:50:03.079078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:50:03.081809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:50:03.155109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-875604da-adcc-4d4f-a4a7-bcd0b60444cd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.229453 Jul 20 13:50:03.166562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 223/465] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:50:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:50:03.171949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:03.172805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:03.206682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:03.207184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:03.208038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:03.208525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:03.255524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-938db8a4-2b31-4844-8213-2e588fe43c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Action: 'create', calling method: .version_select at 0x7fa40d46b5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1444680273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7mPIwpFN+CXHGO7RtZ3Ob1I1cUC3+eX36nPOprqxGfeGZqo+vRhDlcjj7X3JbNhOYDxO0gNVHbSk9QGEGsqxN2f7FVwG9FShNuzY+kMP8O5uQfw+8qZOaaK1FEAlD1cg=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:03.301469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-938db8a4-2b31-4844-8213-2e588fe43c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Getting quotas for project 3095fe6d8f3740d3b6ab3a9e1cc24c5a. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:50:03.310715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-938db8a4-2b31-4844-8213-2e588fe43c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Getting quotas for user 257a55c6a7164a49a9b1ca60e2b8cf53 and project 3095fe6d8f3740d3b6ab3a9e1cc24c5a. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:50:03.383973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-938db8a4-2b31-4844-8213-2e588fe43c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.443954 Jul 20 13:50:03.386983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 243/466] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 13:50:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:03.397181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d5ee6b1a-d922-46bd-a036-0d73ba865465 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:03.397829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d5ee6b1a-d922-46bd-a036-0d73ba865465 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:03.543085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:03.557302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:03.559072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:03.560451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-916d3534-eda7-4781-9c66-1fb3042af6d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.392432 Jul 20 13:50:03.561402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 224/467] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:03.594597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d5ee6b1a-d922-46bd-a036-0d73ba865465 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:03.609640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d5ee6b1a-d922-46bd-a036-0d73ba865465 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1245 microversion: 2.1 time: 0.221433 Jul 20 13:50:03.613706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 244/468] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:03 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1245 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:03.956839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:03.958202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:03.969401 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:03.970047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:03.971391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:03.971898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:04.246487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:04.271085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ef8cc687-1c9e-4338-8560-ada8603f50c6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1473 microversion: 2.1 time: 0.314356 Jul 20 13:50:04.285349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 225/469] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:03 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:04.349836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-60fef56d-fdec-4006-b220-8b543356b7c5 req-73f2d513-cde2-4c1c-98fe-e9ce17107ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a941e2-485c-40b8-9a3a-10cbfcd13160", "name": "network-vif-deleted", "tag": "539a56a6-22d1-407b-b6cb-825ad44c4901"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:04.372677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-60fef56d-fdec-4006-b220-8b543356b7c5 req-73f2d513-cde2-4c1c-98fe-e9ce17107ca4 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:04.373280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-60fef56d-fdec-4006-b220-8b543356b7c5 req-73f2d513-cde2-4c1c-98fe-e9ce17107ca4 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:04.410204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-60fef56d-fdec-4006-b220-8b543356b7c5 req-73f2d513-cde2-4c1c-98fe-e9ce17107ca4 service nova] Creating event network-vif-deleted:539a56a6-22d1-407b-b6cb-825ad44c4901 for instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 on hv-cinder-81914 Jul 20 13:50:04.421812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-60fef56d-fdec-4006-b220-8b543356b7c5 req-73f2d513-cde2-4c1c-98fe-e9ce17107ca4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076620 Jul 20 13:50:04.422560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 245/470] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:04.608884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:04.609667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:04.653662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:04.655852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:04.657625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:04.659848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:04.660142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:04.663121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:04.669581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:04.670035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:04.671693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:04.672838 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:04.679886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:04.791660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:04.805460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3623eddd-6baf-43fa-83fd-4e512441eb3b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1297 microversion: 2.1 time: 0.177912 Jul 20 13:50:04.807887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 246/471] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:04 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1297 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:04.915647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:04.934340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:04.942773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:04.944452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1c2563c8-cfde-4ed5-9cf1-0bc09115243d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.363950 Jul 20 13:50:04.945633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 226/472] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:05.294956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:05.295776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:05.305337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:05.307684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:05.308704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:05.309339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:05.345950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:05.346710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:05.347526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lazy-loading 'fault' on Instance uuid 18a941e2-485c-40b8-9a3a-10cbfcd13160 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:50:05.403766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:05.413191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b9c6dd2-84ee-4c56-9be7-4d5e8c3d7f55 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 200 len: 1309 microversion: 2.1 time: 0.122081 Jul 20 13:50:05.423915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 247/473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:05 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:05.824963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:05.825580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:05.840848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:05.841357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:05.842181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:05.842616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:05.934835 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:05.947548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-00cc221b-7a0c-4e63-a50f-093a6ce28269 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1315 microversion: 2.1 time: 0.125888 Jul 20 13:50:05.959355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 227/474] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:05 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1315 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:05.965331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:05.966212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:05.975775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:05.976168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:05.981086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:05.982826 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:06.196651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:06.212927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:06.214844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:06.218292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0573948c-30af-4aef-a4ca-42f02b928e6b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1739 microversion: 2.20 time: 0.258667 Jul 20 13:50:06.218863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 248/475] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:06.432129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:06.432757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 18a941e2-485c-40b8-9a3a-10cbfcd13160] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:06.434552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:06.440425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:06.441064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:06.441674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:06.442103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:06.456720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] HTTP exception thrown: Instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 could not be found. Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Request method failure captured: Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 HTTP/1.1 Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2Aekm0YwPuu5Wm9Y-swc1i_u6kZE8mGOIUZlnmvNJAknBUpL0FjQ7xSvjO0jgH1fbzMzKYteFzmv2lLoHuue6gWIuX3CAK6pBoygiLYDiDnJ6AMNRV_iRzrd2QmL9WCAbpsjsJhRLY51hJlWA4z0xMYVg_hvGEpVUG_lOVGHr3aHwg8 Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 13:50:06.458357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}] Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: a3e5180dc37741919bc068f5e2302850 Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 could not be found. Jul 20 13:50:06.459882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '18a941e2-485c-40b8-9a3a-10cbfcd13160'} Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 could not be found. Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:50:06.460763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 could not be found. Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 could not be found. Jul 20 13:50:06.461966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 13:50:06.464074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Returning 404 to user: Instance 18a941e2-485c-40b8-9a3a-10cbfcd13160 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:50:06.465126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a2acf0f1-c3a6-4ea2-a075-41446f818fbe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160" status: 404 len: 111 microversion: 2.1 time: 0.037484 Jul 20 13:50:06.465842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 228/476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:06 2022] GET /compute/v2.1/servers/18a941e2-485c-40b8-9a3a-10cbfcd13160 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 13:50:06.968013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:06.968700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:06.976091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:06.976811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:06.977736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:06.978802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:07.079411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:07.089707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ffbbbfcb-5335-4a63-888d-c04aab90a2ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1303 microversion: 2.1 time: 0.125773 Jul 20 13:50:07.090898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 249/477] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:06 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:07.237233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:07.237836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:07.245226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:07.245988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:07.246976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:07.247727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:07.451400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:07.463597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:07.465628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:07.467040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b3e5a768-b3d6-48a3-84a4-a0fe91771298 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1721 microversion: 2.20 time: 0.234323 Jul 20 13:50:07.467585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 229/478] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:08.107285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:08.109619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:08.117128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:08.117684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:08.118552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:08.119084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:08.277035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:08.284861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4897f54c-e016-40a4-9fef-74224ff432e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.181454 Jul 20 13:50:08.285443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 250/479] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:08 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:08.485871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:08.486409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:08.493668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:08.494132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:08.494906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:08.495339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:08.623734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:08.631988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:08.633590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:08.634735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2bc59a5c-90de-493a-8186-f44eb83606da tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1721 microversion: 2.20 time: 0.152894 Jul 20 13:50:08.635284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 230/480] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:09.301845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:09.302452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:09.309672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:09.310125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:09.310909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:09.311354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:09.444180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:09.452989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3864a604-2f4b-41e7-9826-9b0dbcba90b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.155056 Jul 20 13:50:09.454036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 251/481] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:09 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:09.653702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:09.654303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:09.660814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:09.661261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:09.662025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:09.662458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:09.677280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:09.797749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:09.806163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:09.807677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:09.808869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-babbec8a-2de2-475e-8898-02350e52ee20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1721 microversion: 2.20 time: 0.159350 Jul 20 13:50:09.809596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 231/482] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:10.012821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-c478c470-7a03-44d5-8919-123710cd597d req-10b8367a-3abf-4bb2-ba2f-a28cbda3d902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "name": "network-vif-unplugged", "status": "completed", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:10.024567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-c478c470-7a03-44d5-8919-123710cd597d req-10b8367a-3abf-4bb2-ba2f-a28cbda3d902 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:10.025330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-c478c470-7a03-44d5-8919-123710cd597d req-10b8367a-3abf-4bb2-ba2f-a28cbda3d902 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:10.040213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-c478c470-7a03-44d5-8919-123710cd597d req-10b8367a-3abf-4bb2-ba2f-a28cbda3d902 service nova] Creating event network-vif-unplugged:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 13:50:10.045327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-c478c470-7a03-44d5-8919-123710cd597d req-10b8367a-3abf-4bb2-ba2f-a28cbda3d902 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036850 Jul 20 13:50:10.046457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 252/483] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:10.471364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:10.472598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:10.480039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:10.480768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:10.481662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:10.482031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:10.494814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-63987025-42d6-4bfb-979d-4d598c4e2065 req-2405f6af-52e6-456f-a896-66162784cfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b88a32-fbda-4e26-9d53-d40d22586cba", "tag": "119533a5-579b-497a-b65d-fcd7a8d39cd6"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:10.510430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-63987025-42d6-4bfb-979d-4d598c4e2065 req-2405f6af-52e6-456f-a896-66162784cfc5 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:10.511868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-63987025-42d6-4bfb-979d-4d598c4e2065 req-2405f6af-52e6-456f-a896-66162784cfc5 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:10.541372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-63987025-42d6-4bfb-979d-4d598c4e2065 req-2405f6af-52e6-456f-a896-66162784cfc5 service nova] Creating event network-changed:119533a5-579b-497a-b65d-fcd7a8d39cd6 for instance 91b88a32-fbda-4e26-9d53-d40d22586cba on hv-cinder-81914 Jul 20 13:50:10.546734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-63987025-42d6-4bfb-979d-4d598c4e2065 req-2405f6af-52e6-456f-a896-66162784cfc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060169 Jul 20 13:50:10.547523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 253/484] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:50:10.628011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:10.637490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-07bd8aca-f210-4d5a-afdf-6decce8e9e0e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.171118 Jul 20 13:50:10.638506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 232/485] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:10 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:10.827358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:10.828075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:10.834078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:10.834638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:10.835753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:10.836172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:10.976637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:10.985037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:10.986581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:10.987762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-452094f3-acbc-41f2-9219-38ed9fe495d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1721 microversion: 2.20 time: 0.164845 Jul 20 13:50:10.988540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 254/486] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:11.654598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:11.655237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:11.661833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:11.662266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:11.663036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:11.664389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:11.793747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:11.801365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-06b9b7d6-9f87-40ff-afcb-2b97c6cd9ab8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.150715 Jul 20 13:50:11.801961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 233/487] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:11 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:12.006560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:12.007168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:12.014030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:12.014508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:12.015271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:12.015741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:12.157639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:12.166484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:12.168014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:12.169197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d27f8d17-fb7d-41a1-81d4-36b9b04e2999 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1721 microversion: 2.20 time: 0.166526 Jul 20 13:50:12.170221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 255/488] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:12.817612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:12.818212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:12.825213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:12.825653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:12.826416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:12.826845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:12.960038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:12.967322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0b5067bf-02fd-4d6b-a290-43f4a71b9705 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.153511 Jul 20 13:50:12.967873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 234/489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:12 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:13.189843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:13.190415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:13.197591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:13.198031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:13.198782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:13.199281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:13.330807 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:13.338605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:13.340121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:13.341298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2672951a-8432-4d90-9390-2505f87f5737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1721 microversion: 2.20 time: 0.155801 Jul 20 13:50:13.341856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 256/490] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:50:13.983446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:13.984041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:13.985864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:13.986518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:13.993285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:13.993758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:13.994524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:13.994954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:14.135793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:14.143292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d6c91561-f84d-4aa5-b3e3-df829f37c7c8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.163602 Jul 20 13:50:14.143856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 235/491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:13 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:14.359671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:14.360323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:14.362595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=10 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:14.369156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:14.369593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:14.370350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:14.370776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:14.504487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:14.512566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:14.514398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:14.515581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-038175b2-6cbd-44d1-b2bb-25794fa4bee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1721 microversion: 2.20 time: 0.159781 Jul 20 13:50:14.516142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 257/492] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:15.160896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:15.161503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:15.168752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:15.169201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:15.169969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:15.170426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:15.300695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:15.311872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-195b72c7-d3c0-4056-9da2-f681464f6cce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.154737 Jul 20 13:50:15.312659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 236/493] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:15 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:15.534560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:15.535163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:15.542355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:15.542804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:15.543576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:15.544032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:15.675399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:15.684332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:15.685853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:15.687000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-703adc3c-78db-413e-83e1-6755f710f9c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1724 microversion: 2.20 time: 0.156420 Jul 20 13:50:15.687558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 258/494] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:15.705322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8a5d710b-2e5e-46ce-a0ea-a8007cd5b0aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "940d3a00-e48a-4e4f-866b-6f581b36afda"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:15.706441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8a5d710b-2e5e-46ce-a0ea-a8007cd5b0aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:15.712502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a5d710b-2e5e-46ce-a0ea-a8007cd5b0aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:15.712942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a5d710b-2e5e-46ce-a0ea-a8007cd5b0aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:15.713698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a5d710b-2e5e-46ce-a0ea-a8007cd5b0aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:15.714134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a5d710b-2e5e-46ce-a0ea-a8007cd5b0aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:16.008330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8a5d710b-2e5e-46ce-a0ea-a8007cd5b0aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307183 Jul 20 13:50:16.008923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 237/495] 10.222.0.17 () {62 vars in 1363 bytes} [Wed Jul 20 13:50:15 2022] POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:50:16.121518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9cc993a8-ae23-4cc2-be5e-3c9a0002bc33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:16.122075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9cc993a8-ae23-4cc2-be5e-3c9a0002bc33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:16.128471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cc993a8-ae23-4cc2-be5e-3c9a0002bc33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:16.128921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cc993a8-ae23-4cc2-be5e-3c9a0002bc33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:16.129771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cc993a8-ae23-4cc2-be5e-3c9a0002bc33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:16.130199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9cc993a8-ae23-4cc2-be5e-3c9a0002bc33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:16.237574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9cc993a8-ae23-4cc2-be5e-3c9a0002bc33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/action" status: 202 len: 0 microversion: 2.20 time: 0.119850 Jul 20 13:50:16.238400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 259/496] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 13:50:16 2022] POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:50:16.248253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:16.248253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:16.255770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:16.256251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:16.257779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:16.258264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:16.329352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:16.329985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:16.336415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:16.336708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:16.337455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:16.337880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:16.429162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:16.441902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:16.445023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:16.448007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b32c0810-e53b-4802-a559-447c1df0b565 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1750 microversion: 2.20 time: 0.204773 Jul 20 13:50:16.449075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 238/497] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1750 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:16.500155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-25308818", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "networks": [{"uuid": "84a0ba6f-be05-4959-abc1-12c33510b7d9"}]}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:16.560155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] validate_networks() for [('84a0ba6f-be05-4959-abc1-12c33510b7d9', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:50:16.599712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:16.607566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-30f8844f-e6fa-457e-a2ba-530354994fa1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.282286 Jul 20 13:50:16.612146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 260/498] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:16 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:17.007300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:50:17.007895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:50:17.008419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:50:17.008808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:50:17.009214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:50:17.018338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:17.018782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:17.019572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:17.020009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:17.037582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Getting quotas for project 1ddc6ae060994d16b13ff53e80813e83. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:50:17.041957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Getting quotas for user a3e5180dc37741919bc068f5e2302850 and project 1ddc6ae060994d16b13ff53e80813e83. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:50:17.052979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:50:17.055176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:50:17.102376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-227f506e-2c26-4f6f-8efe-56002d4b375c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606003 Jul 20 13:50:17.103621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 239/499] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:50:17.113426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-77b30228-47e5-495a-a76f-41e470950543 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:17.114287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-77b30228-47e5-495a-a76f-41e470950543 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:17.173866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-77b30228-47e5-495a-a76f-41e470950543 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:17.181297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-77b30228-47e5-495a-a76f-41e470950543 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1217 microversion: 2.1 time: 0.071978 Jul 20 13:50:17.182097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 261/500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:17 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:17.467404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:17.468006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:17.473978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:17.474633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:17.475463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:17.475964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:17.610775 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:17.619169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:17.621029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:17.622185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6d04cdc0-ddf9-4349-8584-c0f349b484bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1750 microversion: 2.20 time: 0.159535 Jul 20 13:50:17.622730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 240/501] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:17.624649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:17.625253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:17.641735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:17.642179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:17.642957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:17.643425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:17.774712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:17.782224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1b1f4e1c-28f1-4fcf-adc9-55dc6ea7245d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.161436 Jul 20 13:50:17.782793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 262/502] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:17 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:18.199547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:18.200050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:18.206339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:18.206799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:18.207543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:18.207974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:18.272629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:18.279939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dfd81095-b01e-4c44-b0fc-b253eb97ecfe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1269 microversion: 2.1 time: 0.084597 Jul 20 13:50:18.280535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 241/503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:18 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:18.643335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:18.643955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:18.659893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:18.660580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:18.661741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:18.662329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:18.800930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:18.802264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:18.810021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:18.810932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:18.812144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:18.816430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:18.887204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:18.890568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:18.897178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:18.898664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:18.900002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c14371a2-2930-46b2-aa9a-6bcc2c6c201a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1752 microversion: 2.20 time: 0.263342 Jul 20 13:50:18.904560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 263/504] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1752 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:18.979178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:18.986557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8552caa0-718e-4390-837e-43797027ed4a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.189819 Jul 20 13:50:18.987081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 242/505] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:18 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:19.297936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:19.298668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:19.306185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:19.307439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:19.308248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:19.308869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:19.558867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:19.567038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e715c446-2446-447a-a75f-823c75af7ea6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.272825 Jul 20 13:50:19.567610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 264/506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:19 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:19.920632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:19.922304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:19.947683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:19.948251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:19.954781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:19.955473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:20.003388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:20.003999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:20.021471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:20.022515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:20.023351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:20.024024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:20.163318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:20.175342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:20.176981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:20.178179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3715f3c4-0b03-4b2f-ae6e-baf0ec7e5eca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.263583 Jul 20 13:50:20.191522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 243/507] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:20.228948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-38688367-29cd-43ab-b826-1fb0ba2bda19 req-2da08cb4-d6a2-4bd8-a0b8-b0ec2b82d0aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c2c93bf-5a33-4636-9cad-26c1f1464734", "tag": "d30f84b0-95c0-4dc4-a7a1-aff1a2df68e3"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:20.253325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-38688367-29cd-43ab-b826-1fb0ba2bda19 req-2da08cb4-d6a2-4bd8-a0b8-b0ec2b82d0aa service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:20.253911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-38688367-29cd-43ab-b826-1fb0ba2bda19 req-2da08cb4-d6a2-4bd8-a0b8-b0ec2b82d0aa service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:20.269096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-38688367-29cd-43ab-b826-1fb0ba2bda19 req-2da08cb4-d6a2-4bd8-a0b8-b0ec2b82d0aa service nova] Creating event network-changed:d30f84b0-95c0-4dc4-a7a1-aff1a2df68e3 for instance 5c2c93bf-5a33-4636-9cad-26c1f1464734 on hv-cinder-81914 Jul 20 13:50:20.283739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-38688367-29cd-43ab-b826-1fb0ba2bda19 req-2da08cb4-d6a2-4bd8-a0b8-b0ec2b82d0aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060035 Jul 20 13:50:20.284946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 244/508] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:20.293838 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:20.306785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d144fa64-b164-4768-8bc8-60060708daf7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.306770 Jul 20 13:50:20.308238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 265/509] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:19 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:20.594347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:20.595028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:20.605351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:20.605811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:20.616688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:20.617649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:20.801188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:20.808611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2846f69e-b7fd-4fba-919a-2ff288c1fb86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.219355 Jul 20 13:50:20.809172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 245/510] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:20 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:21.198172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:21.198825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:21.205876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:21.206309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:21.207087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:21.207525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:21.324481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:21.325811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:21.332894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:21.333376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:21.334145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:21.334612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:21.359229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:21.369412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:21.371533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:21.373013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-86259bc8-5dda-4b09-b799-76fff797d580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.179366 Jul 20 13:50:21.374370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 266/511] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:21.490272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:21.492758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:21.499830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2ea24ce7-6ee3-4a61-aa8a-9ce03000a73f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.179381 Jul 20 13:50:21.500610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 246/512] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:21 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:21.826700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:21.828001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:21.834211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:21.835241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:21.836020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:21.836485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:21.992503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:22.002803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bf01058c-ce6d-40a5-92f4-bb1e668711b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.180552 Jul 20 13:50:22.003584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 267/513] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:21 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:22.098238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-6b5ce0be-d671-4341-9eb1-c23575541e83 req-f7d0779e-7837-40dd-ab26-2e2ee368b3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b88a32-fbda-4e26-9d53-d40d22586cba", "name": "network-vif-plugged", "status": "completed", "tag": "119533a5-579b-497a-b65d-fcd7a8d39cd6"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:22.117344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-6b5ce0be-d671-4341-9eb1-c23575541e83 req-f7d0779e-7837-40dd-ab26-2e2ee368b3ee service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:22.117794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-6b5ce0be-d671-4341-9eb1-c23575541e83 req-f7d0779e-7837-40dd-ab26-2e2ee368b3ee service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:22.134894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-6b5ce0be-d671-4341-9eb1-c23575541e83 req-f7d0779e-7837-40dd-ab26-2e2ee368b3ee service nova] Creating event network-vif-plugged:119533a5-579b-497a-b65d-fcd7a8d39cd6 for instance 91b88a32-fbda-4e26-9d53-d40d22586cba on hv-cinder-81914 Jul 20 13:50:22.143238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-6b5ce0be-d671-4341-9eb1-c23575541e83 req-f7d0779e-7837-40dd-ab26-2e2ee368b3ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048585 Jul 20 13:50:22.144527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 247/514] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:22.392371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:22.393014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:22.400105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:22.400518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:22.401281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:22.401709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:22.527571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:22.529259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:22.536963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:22.538353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:22.539359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:22.540013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:22.545634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:22.563866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:22.565467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:22.566955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c5bf8a99-e073-47bc-a295-cc9b201b73cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.178800 Jul 20 13:50:22.578615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 268/515] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:22.699064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:22.707343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8f64e980-f00b-43db-9dee-f41106db3e85 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.188558 Jul 20 13:50:22.708088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 248/516] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:22 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:23.019822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:23.020452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:23.027303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:23.027678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:23.028749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:23.029694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:23.164777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:23.172173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f9e5c13e-eaf6-486a-8f08-aa6e37c242d4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.156411 Jul 20 13:50:23.172755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 269/517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:23 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:23.586733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:23.587511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:23.594968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:23.595418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:23.596230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:23.596666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:23.724395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:23.725133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:23.732468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:23.732917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:23.733756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:23.734250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:23.740451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:23.748654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:23.750490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:23.751659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-49e046b1-e849-48cd-8ce1-c7c83cf9b1b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.169716 Jul 20 13:50:23.752545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 249/518] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:23.878933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:23.886828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-04b57ec9-29a3-4c5d-832a-db51f7c06973 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.166315 Jul 20 13:50:23.887415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 270/519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:23 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:24.190808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:24.191634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:24.201491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:24.204475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:24.205271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:24.216779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:24.366593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:24.374055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b5e5353b-3b26-4f5f-90b9-75afe6058125 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.188268 Jul 20 13:50:24.374610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 250/520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:24 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:24.770382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:24.770982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:24.778617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:24.779409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:24.780424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:24.781045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:24.902936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:24.903547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:24.910379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:24.910824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:24.911600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:24.912033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:24.918940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:24.929060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:24.930947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:24.932447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-14e44082-2821-4c5c-8e56-514b6799da05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.165864 Jul 20 13:50:24.933727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 271/521] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:25.060793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:25.068871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89ac9fd4-a4c1-4758-adfc-ac6cdd36a0a3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.169469 Jul 20 13:50:25.069627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 251/522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:24 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:25.270127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-538067189", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1444680273", "security_groups": [{"name": "tempest-secgroup-smoke-1822414358"}], "networks": [{"uuid": "984bf6e2-3c35-4144-b995-104e989de11f"}], "block_device_mapping_v2": [{"uuid": "f5276dab-cf2e-497a-8bc0-008531090914", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:25.390803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:25.391451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:25.397469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:25.397921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:25.398691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:25.399125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:25.404507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] validate_networks() for [('984bf6e2-3c35-4144-b995-104e989de11f', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 13:50:25.538472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:25.547036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-16688f6e-2413-4030-b4cd-5e879b726556 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.160024 Jul 20 13:50:25.548013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 252/523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:25 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:25.816571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 13:50:25.817090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 13:50:25.817486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 13:50:25.817920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 13:50:25.818333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:50:25.818454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 13:50:25.818555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 13:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:50:25.829031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:25.829481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:25.830382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:25.830817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:25.849120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Getting quotas for project 3095fe6d8f3740d3b6ab3a9e1cc24c5a. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 13:50:25.853811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Getting quotas for user 257a55c6a7164a49a9b1ca60e2b8cf53 and project 3095fe6d8f3740d3b6ab3a9e1cc24c5a. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 13:50:25.921591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 13:50:25.923739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5276dab-cf2e-497a-8bc0-008531090914',volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 13:50:25.951184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:25.951891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:25.961591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:25.962193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:25.963177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:25.963748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:26.088575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-90fddb1e-7998-4a69-9e5c-ed9705775b42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822967 Jul 20 13:50:26.089542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 272/524] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 13:50:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 13:50:26.102439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:26.103083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:26.120742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:26.121702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:26.123277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:26.123608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:26.140953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:26.151229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:26.152785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:26.153946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c984f531-7223-4e06-83ff-2ccd197fcb66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.206986 Jul 20 13:50:26.154688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 253/525] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:50:26.159049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ab5b5656-b739-4ba1-af87-a8f093dbb81e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:26.159656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ab5b5656-b739-4ba1-af87-a8f093dbb81e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:26.226294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ab5b5656-b739-4ba1-af87-a8f093dbb81e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:26.233460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ab5b5656-b739-4ba1-af87-a8f093dbb81e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1088 microversion: 2.1 time: 0.077840 Jul 20 13:50:26.243626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 254/526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1088 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:26.303914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:26.313292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-37e08236-a1a5-4bba-b945-a78aa58827fd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.222411 Jul 20 13:50:26.314088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 273/527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:26 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:26.563848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:26.564402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:26.570622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:26.571068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:26.571826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:26.572286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:26.723022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:26.731475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-03d52e44-4061-4de0-b68a-4d7546c9b2d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.171617 Jul 20 13:50:26.732041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 255/528] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:26 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:27.173058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:27.173674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:27.181915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.182438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.183471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.183966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.250013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:27.251323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:27.254047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:27.260766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.261220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.262006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.262439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.330687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:27.332692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:27.339573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f9656575-6d17-42be-b11d-5115a9d1f731 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1138 microversion: 2.1 time: 0.093383 Jul 20 13:50:27.340159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 256/529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:27.343398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:27.344923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:27.346107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ddb85db5-ace7-4163-844b-8ef8fd611d4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.177141 Jul 20 13:50:27.348230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 274/530] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:27.352583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:27.353187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:27.359300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.359770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.360557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.360983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.508166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:27.517139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5ed62aba-9b67-44fe-ae78-94d5a1195958 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.171063 Jul 20 13:50:27.517718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 257/531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:27 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:27.748930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:27.749450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:27.751317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:27.757384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.757829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.758603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:27.759036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:27.896086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:27.905293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d7e34498-4c08-4bad-80f0-00de801eeca8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.160384 Jul 20 13:50:27.906191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 275/532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:27 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:28.356961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:28.357545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:28.363598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.363779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:28.364237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:28.364560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:28.364914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.365347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:28.372164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.372660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:28.373439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.373875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:28.441674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:28.449710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7128c1f7-5ef3-4b72-87fe-db961ecf48ba tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1138 microversion: 2.1 time: 0.096618 Jul 20 13:50:28.450277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 258/533] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:28.534767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:28.535385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:28.543914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.544397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:28.545182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.545619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:28.557832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:28.566732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:28.568436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:28.570553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-602bfc3a-929b-422d-a7e4-e85f985dcbb5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.210313 Jul 20 13:50:28.570954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 276/534] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:28.695872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:28.705427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d59a0f38-ff8a-483c-9d95-3326a16612b0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.175179 Jul 20 13:50:28.706195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 259/535] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:28 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:28.922776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:28.923381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:28.929448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.929921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:28.930680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:28.931111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:29.064030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:29.072301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2eb1e7a3-f29b-488c-83c5-82de8939f766 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.153312 Jul 20 13:50:29.073076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 277/536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:28 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:29.468849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:29.468849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:29.486383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:29.486833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:29.487611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:29.488040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:29.557989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:29.565609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c86c68b9-dd61-41d5-a934-1b6ace93ef25 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1138 microversion: 2.1 time: 0.103019 Jul 20 13:50:29.566169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 260/537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1138 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:29.590472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:29.591905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:29.600914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:29.601956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:29.603109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:29.603858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:29.722791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:29.723344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:29.729895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:29.730385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:29.731148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:29.731587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:29.742212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:29.750645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:29.752130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:29.753304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4de0f430-cde0-4666-93af-b7db96620aa2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.167398 Jul 20 13:50:29.754337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 278/538] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:29.872984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:29.880745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f0ef6f89-85cd-48c2-9f91-86f719d6bf33 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.161858 Jul 20 13:50:29.881306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 261/539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:29 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:30.088094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:30.088734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:30.094739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.095183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.095942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.096409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.227763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:30.235125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-516eeb9e-a005-4f7f-8ce8-93279974a073 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.150851 Jul 20 13:50:30.235687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 279/540] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:30 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:30.584681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:30.585318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:30.591654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.592098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.593090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.593645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.655292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:30.663339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-843c56e2-d0c3-4a6c-b12c-e2d6659c83f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1130 microversion: 2.1 time: 0.083334 Jul 20 13:50:30.663880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 262/541] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1130 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:30.772304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:30.772913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:30.779442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.779893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.780687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.781119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.897909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:30.898672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:30.904639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.905159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.905993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:30.906515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:30.915895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:30.924408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:30.925960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:30.927144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2deae5ef-0044-4d12-ba5d-4b6cfb2fef6f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.158930 Jul 20 13:50:30.927737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 280/542] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:31.035888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:31.043951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6e0a263b-79e9-41c0-be37-487658b6d2ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.150459 Jul 20 13:50:31.044543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 263/543] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:30 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:31.251465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:31.252066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:31.258825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:31.259274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:31.260041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:31.260517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:31.264568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:31.386652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:31.394150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b45a617c-393f-4c26-b702-a745fb0a54f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.146522 Jul 20 13:50:31.394717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 281/544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:31 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:31.680848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:31.681459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:31.687988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:31.688484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:31.689250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:31.689689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:31.749367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:31.757375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0fbdd93f-ba50-4dad-8866-c9cea99d135e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1186 microversion: 2.1 time: 0.080867 Jul 20 13:50:31.757967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 264/545] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1186 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:31.946102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:31.946708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:31.953416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:31.953862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:31.954627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:31.955062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:32.060657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:32.061253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:32.067102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:32.067541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:32.068328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:32.069014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:32.073212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:32.086652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:32.094997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:32.096534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:32.097715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-907105dd-b705-485e-a87c-56d5bc561006 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.156137 Jul 20 13:50:32.098278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 282/546] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:32.205564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:32.214317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aba46cf1-2ef6-4d17-a81f-0dab970d70b8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.157450 Jul 20 13:50:32.214876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 265/547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:32 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:32.410722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:32.411351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:32.417323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:32.417771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:32.418533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:32.419038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:32.550332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:32.558570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-140ff3a9-5baf-498c-b154-d9e4a1f8f9f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.151714 Jul 20 13:50:32.559143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 283/548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:32 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:32.773761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:32.774911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:32.780750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:32.781192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:32.781950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:32.782378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:32.842103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:32.849382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46801ebe-d838-40b8-b941-c291d261fa56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1186 microversion: 2.1 time: 0.079532 Jul 20 13:50:32.850658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 266/549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:33.116283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:33.116966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:33.123339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.123786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.124583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.125015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.230861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:33.231459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:33.237606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.238046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.238802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.239228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.253021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:33.261995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:33.263495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:33.264763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28999719-4c39-43d1-a403-c95b20ab579a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.152439 Jul 20 13:50:33.265511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 284/550] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:50:33.369345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:33.376657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a3484b04-8cd8-4e7d-aef4-f8e17d3b921d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.149695 Jul 20 13:50:33.377220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 267/551] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:33 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:33.588137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:33.589035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:33.596159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.597264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.598063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.598884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.810843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:33.818162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fc2e4e73-0165-40b7-999e-341ff7886a49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.236141 Jul 20 13:50:33.818893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 285/552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:33 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:33.866683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:33.867207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:33.873869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.874308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.875075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:33.875502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:33.936225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:33.943759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7b42837f-ff35-422f-a368-f4ddc0fdcc71 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1204 microversion: 2.1 time: 0.081587 Jul 20 13:50:33.944333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 268/553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1204 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:34.282721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:34.283332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:34.290799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.291261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:34.292109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.292562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:34.397814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:34.398451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:34.405018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.405470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:34.406248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.406679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:34.474354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:34.484470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:34.486103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:34.487597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-abd7d8d8-052e-4978-a52d-81680bc00e20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.208758 Jul 20 13:50:34.497031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 286/554] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:34.547649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:34.556181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a6a16dc6-b5d1-4c9d-8e89-fd17d5f3aba2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1371 microversion: 2.1 time: 0.165922 Jul 20 13:50:34.556782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 269/555] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:34 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:34.835673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:34.836212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:34.842374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.842822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:34.843591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.844047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:34.961064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:34.962252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:34.969212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:34.973063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.973828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:34.975499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:34.976125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:35.046587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:35.056300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f722d40b-e5e5-43a1-a3b1-3c47a7c191f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1204 microversion: 2.1 time: 0.099134 Jul 20 13:50:35.057399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 270/556] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:35.098790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:35.106940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8871f56b-175b-4a75-9af5-5b897280e00b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.275784 Jul 20 13:50:35.107656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 287/557] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:34 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:35.507108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:35.507699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:35.515317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:35.515774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:35.516958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:35.517394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:35.575548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:35.576350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:35.583404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:35.583852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:35.584666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:35.585107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:35.818205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:35.825998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6df3619a-6a14-4868-9633-2760c3b068dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1566 microversion: 2.1 time: 0.255790 Jul 20 13:50:35.827491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 288/558] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:35 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:35.846791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d2c7872b-8478-42e1-a74f-c30f39a75b23 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:35.847440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d2c7872b-8478-42e1-a74f-c30f39a75b23 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:35.857921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:35.860471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2c7872b-8478-42e1-a74f-c30f39a75b23 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:35.861138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2c7872b-8478-42e1-a74f-c30f39a75b23 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:35.862956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2c7872b-8478-42e1-a74f-c30f39a75b23 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:35.864099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2c7872b-8478-42e1-a74f-c30f39a75b23 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:35.866186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=8 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:35.893779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:35.905014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:35.907105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:35.908513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7005c450-ff40-4268-b91a-59214cf6a9ee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.405959 Jul 20 13:50:35.909810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 271/559] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:35.989185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d2c7872b-8478-42e1-a74f-c30f39a75b23 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149653 Jul 20 13:50:35.989787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 289/560] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 13:50:35 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:36.067221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-96c90d3a-10e3-49f6-a8fa-39c640c28d84 req-9b12e38e-c57b-4207-97c5-e6cb2e6928f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f9c037-a55c-46c4-aae3-4929db5f0193", "tag": "f1fd1db3-83b1-4e8d-a486-5ac886455b89"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:36.076232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:36.078703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:36.093187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-96c90d3a-10e3-49f6-a8fa-39c640c28d84 req-9b12e38e-c57b-4207-97c5-e6cb2e6928f2 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.093712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-96c90d3a-10e3-49f6-a8fa-39c640c28d84 req-9b12e38e-c57b-4207-97c5-e6cb2e6928f2 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:36.097220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.097691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:36.099031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.100120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:36.109269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-96c90d3a-10e3-49f6-a8fa-39c640c28d84 req-9b12e38e-c57b-4207-97c5-e6cb2e6928f2 service nova] Creating event network-changed:f1fd1db3-83b1-4e8d-a486-5ac886455b89 for instance 36f9c037-a55c-46c4-aae3-4929db5f0193 on hv-cinder-81914 Jul 20 13:50:36.126884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-96c90d3a-10e3-49f6-a8fa-39c640c28d84 req-9b12e38e-c57b-4207-97c5-e6cb2e6928f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067455 Jul 20 13:50:36.130492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 272/561] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:36.135790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:36.139129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:36.157369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.160570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:36.162781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.166933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:36.230680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=8 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:36.358756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:36.368132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ebbc8784-eb47-4317-85da-bcef66fc09cb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.296946 Jul 20 13:50:36.386049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 290/562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:36.401321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:36.409497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-799bf22d-5dca-4620-8e15-1089c65e02ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.277526 Jul 20 13:50:36.410281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 273/563] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:36 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:36.761136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-dc595193-7141-4c1c-a448-e10d3b98be2c req-dfa709c1-2de3-4ea9-83be-eb44d034655b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2c93bf-5a33-4636-9cad-26c1f1464734", "name": "network-vif-plugged", "status": "completed", "tag": "d30f84b0-95c0-4dc4-a7a1-aff1a2df68e3"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:36.769991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-dc595193-7141-4c1c-a448-e10d3b98be2c req-dfa709c1-2de3-4ea9-83be-eb44d034655b service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.770432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-dc595193-7141-4c1c-a448-e10d3b98be2c req-dfa709c1-2de3-4ea9-83be-eb44d034655b service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:36.782064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-dc595193-7141-4c1c-a448-e10d3b98be2c req-dfa709c1-2de3-4ea9-83be-eb44d034655b service nova] Creating event network-vif-plugged:d30f84b0-95c0-4dc4-a7a1-aff1a2df68e3 for instance 5c2c93bf-5a33-4636-9cad-26c1f1464734 on hv-cinder-81914 Jul 20 13:50:36.787876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-dc595193-7141-4c1c-a448-e10d3b98be2c req-dfa709c1-2de3-4ea9-83be-eb44d034655b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030017 Jul 20 13:50:36.788518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 291/564] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:36.927199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:36.928527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:36.936267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.936846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:36.937732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:36.938272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:37.199661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-97ebef27-ea39-40e9-a28d-531a02e192c0 req-d444c560-ed97-4758-8c23-f4fa24457012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b88a32-fbda-4e26-9d53-d40d22586cba", "tag": "119533a5-579b-497a-b65d-fcd7a8d39cd6"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:37.204149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:37.216073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:37.217366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-97ebef27-ea39-40e9-a28d-531a02e192c0 req-d444c560-ed97-4758-8c23-f4fa24457012 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:37.217891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-97ebef27-ea39-40e9-a28d-531a02e192c0 req-d444c560-ed97-4758-8c23-f4fa24457012 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:37.219481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:37.221219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-57c28f62-7171-44ca-9546-40e63b2a91ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.298291 Jul 20 13:50:37.223084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 274/565] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 13:50:37.236994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-97ebef27-ea39-40e9-a28d-531a02e192c0 req-d444c560-ed97-4758-8c23-f4fa24457012 service nova] Creating event network-changed:119533a5-579b-497a-b65d-fcd7a8d39cd6 for instance 91b88a32-fbda-4e26-9d53-d40d22586cba on hv-cinder-81914 Jul 20 13:50:37.242859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-97ebef27-ea39-40e9-a28d-531a02e192c0 req-d444c560-ed97-4758-8c23-f4fa24457012 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051707 Jul 20 13:50:37.243894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 292/566] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:37.385920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:37.386544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:37.392595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:37.393109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:37.393878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:37.394308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:37.430050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:37.431174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:37.437529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:37.438123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:37.439012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:37.439539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:37.571251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:37.581651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9f30626a-f8d6-4e49-b851-b0b8911671e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.199594 Jul 20 13:50:37.583171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 275/567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:37.667699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:37.676130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c477a6dd-d27c-4c6b-9c45-890cd1553845 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.252427 Jul 20 13:50:37.678418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 293/568] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:37 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:38.242470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:38.243596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:38.250096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:38.250551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:38.251361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:38.251800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:38.458479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:38.467773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:38.469328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:38.470471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e7f9efff-c7cc-4bd9-932c-5940bcc9be13 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.233770 Jul 20 13:50:38.471028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 276/569] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:38.598779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:38.599317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:38.608915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:38.609365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:38.610140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:38.610581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:38.695237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:38.696315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:38.703305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:38.703834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:38.704711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:38.705760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:38.758509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:38.765850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-09d10f73-4ed7-4f3f-bbb5-8339cf0c576e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.171069 Jul 20 13:50:38.766415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 294/570] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:38.810476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-8ad2b162-f900-4eb3-ba5b-e5ef0cba043c req-9fa15cfe-1db5-4d78-8480-b7af3bf8ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "name": "network-vif-plugged", "status": "completed", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:38.819049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-8ad2b162-f900-4eb3-ba5b-e5ef0cba043c req-9fa15cfe-1db5-4d78-8480-b7af3bf8ede6 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:38.819485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-8ad2b162-f900-4eb3-ba5b-e5ef0cba043c req-9fa15cfe-1db5-4d78-8480-b7af3bf8ede6 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:38.830606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-8ad2b162-f900-4eb3-ba5b-e5ef0cba043c req-9fa15cfe-1db5-4d78-8480-b7af3bf8ede6 service nova] Creating event network-vif-plugged:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 13:50:38.836299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-8ad2b162-f900-4eb3-ba5b-e5ef0cba043c req-9fa15cfe-1db5-4d78-8480-b7af3bf8ede6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029300 Jul 20 13:50:38.836899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 295/571] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:50:38.838594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:38.850289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-de62eb9f-4f41-4773-938c-2b0262ae55a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1317 microversion: 2.1 time: 0.161217 Jul 20 13:50:38.850772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 277/572] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:38 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:39.489117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:39.489729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:39.496425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:39.496870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:39.497627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:39.498059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:39.630118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:39.638677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:39.640159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:39.641403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7e392ea9-f571-49ca-b57f-d86d10dea2f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.156758 Jul 20 13:50:39.641962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 296/573] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:39.784439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:39.784989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:39.791936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:39.792443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:39.793196 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:39.793627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:39.868862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:39.869474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:39.875497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:39.875946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:39.876789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:39.877220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:39.941343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:39.949918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-deb321f0-300e-46d1-b46b-b799a9e07ee4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.170039 Jul 20 13:50:39.950529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 278/574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:40.015615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:40.023184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0adfd3b2-d247-4f35-b718-1264e42a1ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1506 microversion: 2.1 time: 0.160421 Jul 20 13:50:40.023745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 297/575] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:39 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:50:40.039329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-11638130-5149-49ab-bad6-95296cdc722f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2c252c2-019e-4cb6-832e-3b3cb976175e", "device": "/dev/sdb"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:40.040921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-11638130-5149-49ab-bad6-95296cdc722f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:40.046865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11638130-5149-49ab-bad6-95296cdc722f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:40.047319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11638130-5149-49ab-bad6-95296cdc722f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:40.048085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11638130-5149-49ab-bad6-95296cdc722f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:40.048565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11638130-5149-49ab-bad6-95296cdc722f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:40.445302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-11638130-5149-49ab-bad6-95296cdc722f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "POST /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409783 Jul 20 13:50:40.445906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 279/576] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 13:50:40 2022] POST /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:50:40.658865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:40.659465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:40.666555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:40.666995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:40.667813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:40.668265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:40.796017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:40.804716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:40.806209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:40.807340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f942285f-d731-456f-9fb3-229d81bb2de4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.152478 Jul 20 13:50:40.807894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 298/577] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:40.968360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:40.969045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:40.976177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:40.976648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:40.977412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:40.977844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:41.109299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:41.117217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-90ee933e-affc-465d-9b99-4d906b18dbf1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.152435 Jul 20 13:50:41.117774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 280/578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:41.825272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:41.826085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:41.832487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:41.832956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:41.833731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:41.834151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:41.972888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:41.981782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:41.983272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:41.984456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-95a57d62-98dd-4bcd-b261-aa02ae5c0f0c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1808 microversion: 2.20 time: 0.163129 Jul 20 13:50:41.985013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 299/579] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:42.133842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:42.134645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:42.141240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:42.141757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:42.142601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:42.143117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:42.145854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:42.278348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:42.285753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9cc1991a-f393-40f5-9158-8ad272548174 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.155804 Jul 20 13:50:42.286312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 281/580] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:43.002017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:43.002619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:43.009393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:43.009844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:43.010620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:43.011055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:43.015189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:43.143402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:43.152723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:43.154212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:43.155346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-55f697da-6095-438f-845c-78bc4f59463f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1795 microversion: 2.20 time: 0.157368 Jul 20 13:50:43.155899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 300/581] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 13:50:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 13:50:43.304116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:43.304646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:43.311036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:43.311481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:43.312322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:43.312771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:43.447977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:43.455626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dc460a11-2bd7-4c64-adf1-321318771f16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.155470 Jul 20 13:50:43.456181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 282/582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:44.472982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:44.473585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:44.480055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:44.480528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:44.481317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:44.481748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:44.611406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:44.619239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f2f7c331-9261-4d2b-b72d-e4a96c32df20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.150123 Jul 20 13:50:44.619804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 301/583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:45.635927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:45.636480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:45.643050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:45.643491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:45.644296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:45.644731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:45.777192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:45.784608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-57e5054a-f915-46ac-a106-bd631883e9b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.152585 Jul 20 13:50:45.785158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 283/584] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:46.802157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:46.803061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:46.811382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:46.812040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:46.813391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:46.813829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:46.947333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:46.955037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-842fb6d0-7c99-459f-a550-9a54347d6c55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.157295 Jul 20 13:50:46.955619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 302/585] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:47.300688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:47.301241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:47.308143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:47.308641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:47.309409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:47.309838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:47.433912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lazy-loading 'services' on Instance uuid 1aa1a351-f890-4b69-9606-4fa868d1443d {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:50:47.548783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b201dd90-dde9-4629-a1e9-375ce6705782 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments/67b9b900-8110-45ab-b3cd-5cd90f906b29" status: 202 len: 0 microversion: 2.1 time: 0.251874 Jul 20 13:50:47.549363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 284/586] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 13:50:47 2022] DELETE /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments/67b9b900-8110-45ab-b3cd-5cd90f906b29 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:50:47.971623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:47.972288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:47.978323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:47.978768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:47.979530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:47.979958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:48.116176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:48.126264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-63ccf21d-872b-41fd-ae45-9c416c39f01e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.158476 Jul 20 13:50:48.126826 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 303/587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:48.793968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-9db980e2-8530-45f9-887e-0a03a932b1c0 req-17a8e347-258b-4cd1-af2c-889086bd482f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f9c037-a55c-46c4-aae3-4929db5f0193", "name": "network-vif-plugged", "status": "completed", "tag": "f1fd1db3-83b1-4e8d-a486-5ac886455b89"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:50:48.802287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-9db980e2-8530-45f9-887e-0a03a932b1c0 req-17a8e347-258b-4cd1-af2c-889086bd482f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:48.802837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-9db980e2-8530-45f9-887e-0a03a932b1c0 req-17a8e347-258b-4cd1-af2c-889086bd482f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:48.814261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-9db980e2-8530-45f9-887e-0a03a932b1c0 req-17a8e347-258b-4cd1-af2c-889086bd482f service nova] Creating event network-vif-plugged:f1fd1db3-83b1-4e8d-a486-5ac886455b89 for instance 36f9c037-a55c-46c4-aae3-4929db5f0193 on hv-cinder-81914 Jul 20 13:50:48.818833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-9db980e2-8530-45f9-887e-0a03a932b1c0 req-17a8e347-258b-4cd1-af2c-889086bd482f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029352 Jul 20 13:50:48.819419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 285/588] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:50:49.142939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:49.143550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:49.150513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:49.150957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:49.151727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:49.152156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:49.282159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:49.289479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bb6352e5-a54f-42fd-b00b-0ddb27b7ee2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.150441 Jul 20 13:50:49.290056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 304/589] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:50.308490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:50.309088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:50.315303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:50.315758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:50.316551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:50.316997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:50.451253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:50.462225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-18e8490f-b323-4276-b7f8-f4ee95e81a4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.159196 Jul 20 13:50:50.462804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 286/590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:51.479449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:51.479982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:51.486383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:51.486821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:51.487570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:51.487994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:51.618351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:51.626156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-56bac201-4a13-49ad-b9c2-7f4cbc846403 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.151188 Jul 20 13:50:51.626719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 305/591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:52.643080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:52.643690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:52.650343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:52.650792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:52.651591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:52.652021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:52.779125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:52.787316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b3b7f1cb-4683-4f40-855f-72156d708fc2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.148235 Jul 20 13:50:52.787885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 287/592] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:53.804137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:53.804762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:53.811236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:53.811729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:53.812520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:53.812949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:53.949811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:53.957448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-56041c37-830a-4b04-9e78-9122b86123a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.157354 Jul 20 13:50:53.958009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 306/593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:54.974523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:54.975127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:54.981686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:54.982127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:54.982886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:54.983315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:55.111082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:55.118875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-db069ffa-578b-4ec6-9c96-35cb9befdd44 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.148246 Jul 20 13:50:55.119561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 288/594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:56.135999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:56.136623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:56.143321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:56.143766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:56.144557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:56.144990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:56.273671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:56.281034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28ade005-cfed-476e-960d-2ebfe91400f9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.149431 Jul 20 13:50:56.281600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 307/595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:57.297902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:57.298462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:57.305336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:57.305802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:57.306658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:57.307136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:57.438828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:57.446359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7b646dff-12ea-49b3-904a-6f7f3d4be269 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.152569 Jul 20 13:50:57.446918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 289/596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:58.462902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:58.463563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:58.465996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=66 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:58.471657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:58.472107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:58.472897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:58.473356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:58.607720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:58.615434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b3e7a2bb-67fc-47ae-84bd-10143985ed9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.156314 Jul 20 13:50:58.615947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 308/597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:50:59.632324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:50:59.632938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:50:59.639639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:59.640108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:59.640909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:50:59.641344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:50:59.769982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:50:59.777956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fcc70067-591d-4527-a106-56c0f6837b62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.149631 Jul 20 13:50:59.778512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 290/598] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:50:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:00.794538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:00.795063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:00.801442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:00.801881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:00.802631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:00.803054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:00.930779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:00.938117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9afae6af-589e-4cda-9b73-108e374c67b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.147518 Jul 20 13:51:00.938696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 309/599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:01.955195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:01.955806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:01.962778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:01.963228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:01.963990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:01.964459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:02.097012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:02.104822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-75f7e582-27d8-4417-bed7-1dbdeb6722f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.153849 Jul 20 13:51:02.105378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 291/600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:03.122080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:03.122698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:03.129051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:03.129489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:03.130261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:03.130685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:03.261991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:03.269536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7884de65-0151-4684-b5f6-5b1c3c61dcb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.151275 Jul 20 13:51:03.270104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 310/601] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:04.286853 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:04.287358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:04.293804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:04.294244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:04.294988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:04.295412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:04.424415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:04.433608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-663b032a-850d-4f88-919f-3c084f3f0593 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.150472 Jul 20 13:51:04.434211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 292/602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:05.450558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:05.451166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:05.457997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:05.458444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:05.459209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:05.459644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:05.591041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:05.598559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8a120113-cb25-4424-b128-fc5e0b5775d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.151948 Jul 20 13:51:05.599137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 311/603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:06.614602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:06.615212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:06.617652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=46 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:06.622916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:06.623359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:06.624117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:06.624575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:06.760860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:06.768244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7d814a4b-4fe9-4f10-88f7-f8d3bd275ac6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.157377 Jul 20 13:51:06.768806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 293/604] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:07.785025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:07.785637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:07.792543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:07.792995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:07.793762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:07.794200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:07.924802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:07.933083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dfae521e-2c17-4284-b804-2a039801f38e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.151893 Jul 20 13:51:07.933658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 312/605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:08.950574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:08.951177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:08.957990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:08.958431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:08.959189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:08.959619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:09.086773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:09.094096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-adc0b3c0-3922-42e6-b9b0-212e401bd56b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.147419 Jul 20 13:51:09.094657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 294/606] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:10.110196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:10.110798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:10.118012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:10.118451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:10.119202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:10.119627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:10.249222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:10.257054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1051803c-51e1-4458-bc12-50e5430ce48a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.150558 Jul 20 13:51:10.257635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 313/607] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:11.274380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:11.275002 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:11.281392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:11.281833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:11.282580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:11.283006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:11.409702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:11.417024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d8d5da9d-b6f6-491a-a10e-5ba2fde1e623 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.147061 Jul 20 13:51:11.417589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 295/608] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:12.434258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:12.434865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:12.441345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:12.441788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:12.442628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:12.443062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:12.575483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:12.583154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d8e80608-42c4-4745-bc34-369e96dc3bfe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.152810 Jul 20 13:51:12.583725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 314/609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:13.600883 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:13.601486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:13.607878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:13.608350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:13.609111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:13.609542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:13.613405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:13.745910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:13.753427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ed616e1c-e99e-472b-9bd2-9b6cae9d151d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.156914 Jul 20 13:51:13.753989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 296/610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:14.770914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:14.771554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:14.779354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:14.779790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:14.780578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:14.781003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:14.784808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=89 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:14.915626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:14.923103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0d72a7c7-e230-4e94-b9b4-39f4ee58daa3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.156662 Jul 20 13:51:14.923668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 315/611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:15.939759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:15.940392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:15.946977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:15.947423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:15.948211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:15.948642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:16.077664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:16.084986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4cafc21b-0194-4455-b9ec-86285c98ca8b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.149057 Jul 20 13:51:16.085547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 297/612] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:17.101757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:17.102370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:17.108609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:17.109060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:17.109827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:17.110262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:17.242389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:17.250200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-de0c82d8-78c0-4f07-a76d-50ac187e4ac4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.152268 Jul 20 13:51:17.250779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 316/613] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:18.267316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:18.267899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:18.275158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:18.275611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:18.276408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:18.276846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:18.409299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:18.416497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2ec4bdff-67b8-4404-ac00-5794430e3e3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.153411 Jul 20 13:51:18.417051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 298/614] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:19.433742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:19.434385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:19.440799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:19.441245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:19.442008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:19.442437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:19.580233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:19.587671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-38aa05eb-9d44-45b5-9b27-f00984fc0339 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.157866 Jul 20 13:51:19.588262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 317/615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:20.604913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:20.605442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:20.611946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:20.612434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:20.613195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:20.613628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:20.743738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:20.751088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-923bb887-e1aa-4512-9d5b-ea2dc1cf0e52 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.150154 Jul 20 13:51:20.751647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 299/616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:21.767748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:21.768328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:21.775477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:21.775917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:21.776710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:21.777144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:21.905348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:21.912740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d1aabb2f-8a83-40f1-aee3-bf80d4557dc5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.148922 Jul 20 13:51:21.913304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 318/617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:22.929992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:22.930705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:22.937165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:22.937613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:22.938382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:22.938820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:23.065560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:23.072924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f16da763-085d-4435-b8d1-d78133fea059 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.147411 Jul 20 13:51:23.073483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 300/618] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:23.876769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-47901534-b74f-4779-bf33-398a8aec0858 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23e3165e-acad-4481-b456-954b7838e4fd"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:51:23.877837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-47901534-b74f-4779-bf33-398a8aec0858 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:23.885075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47901534-b74f-4779-bf33-398a8aec0858 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:23.885515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47901534-b74f-4779-bf33-398a8aec0858 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:23.886272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47901534-b74f-4779-bf33-398a8aec0858 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:23.886701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47901534-b74f-4779-bf33-398a8aec0858 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:24.089000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:24.089613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:24.096064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:24.096542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:24.097309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:24.097746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:24.230416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:24.237723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1c48143e-100a-4a87-b3ca-5b4884199e84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.152575 Jul 20 13:51:24.238277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 301/619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:24 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:25.254376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:25.255018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:25.262348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:25.262803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:25.263574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:25.264006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:25.397655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:25.405130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6014d52d-1212-4f58-adac-455fcbdb5b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.154684 Jul 20 13:51:25.405693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 302/620] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:26.421986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:26.422615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:26.430398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:26.430846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:26.431644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:26.432074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:26.564857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:26.572682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-db90d35b-2682-4a2a-a3c8-e9a7c49c8c81 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.154520 Jul 20 13:51:26.573244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 303/621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:27.590142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:27.590810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:27.597220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:27.597656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:27.598413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:27.598838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:27.728846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:27.736248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-25bfd5a1-6817-4e5c-bb30-7831d85f1cd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.149894 Jul 20 13:51:27.736814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 304/622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:28.753231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:28.753828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:28.760713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:28.761148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:28.761899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:28.762353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:28.894082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:28.902199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3a8a5a84-f0d2-4084-be27-f643327e95a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.152851 Jul 20 13:51:28.902758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 305/623] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:29.918912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:29.919529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:29.925814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:29.926253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:29.927001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:29.927429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:30.056566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:30.063984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a20f9abf-ff71-48c2-a629-e2fe962593c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.148882 Jul 20 13:51:30.064564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 306/624] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:31.081482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:31.082202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:31.088702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.089153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.089911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.090373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.218174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:31.227570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fcd3a94f-9d29-4168-9717-57376e886d0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.149901 Jul 20 13:51:31.228148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 307/625] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:31.233595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a35b2cf3-2fb0-4789-9627-4a5be69b745f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:31.234087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a35b2cf3-2fb0-4789-9627-4a5be69b745f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:31.240348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a35b2cf3-2fb0-4789-9627-4a5be69b745f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.240866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a35b2cf3-2fb0-4789-9627-4a5be69b745f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.241671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a35b2cf3-2fb0-4789-9627-4a5be69b745f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.242099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a35b2cf3-2fb0-4789-9627-4a5be69b745f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.269805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a35b2cf3-2fb0-4789-9627-4a5be69b745f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments/940d3a00-e48a-4e4f-866b-6f581b36afda" status: 200 len: 194 microversion: 2.20 time: 0.040659 Jul 20 13:51:31.270369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 308/626] 10.222.0.17 () {60 vars in 1453 bytes} [Wed Jul 20 13:51:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments/940d3a00-e48a-4e4f-866b-6f581b36afda => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:31.331003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:31.331492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:31.338015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.338460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.339219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.339653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.416940 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lazy-loading 'services' on Instance uuid 8bf47794-d975-439d-85ed-1a2fd9cbd791 {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:51:31.486432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-25e1c03f-9816-4cef-8de1-9e547df21c78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments/940d3a00-e48a-4e4f-866b-6f581b36afda" status: 202 len: 0 microversion: 2.20 time: 0.159130 Jul 20 13:51:31.487008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 309/627] 10.222.0.17 () {60 vars in 1456 bytes} [Wed Jul 20 13:51:31 2022] DELETE /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments/940d3a00-e48a-4e4f-866b-6f581b36afda => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 13:51:31.496772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a6de5f3b-760c-40fb-b46f-e84d54670a90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:31.497827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a6de5f3b-760c-40fb-b46f-e84d54670a90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:31.503979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6de5f3b-760c-40fb-b46f-e84d54670a90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.504455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6de5f3b-760c-40fb-b46f-e84d54670a90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.505212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6de5f3b-760c-40fb-b46f-e84d54670a90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:31.505728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a6de5f3b-760c-40fb-b46f-e84d54670a90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:31.537383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a6de5f3b-760c-40fb-b46f-e84d54670a90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044581 Jul 20 13:51:31.537945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 310/628] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:51:32.244305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:32.244907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:32.251278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:32.251714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:32.252488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:32.252913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:32.389177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:32.396522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6ff81ba6-55ec-4cf9-a993-b49450bba427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.156111 Jul 20 13:51:32.397089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 311/629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:32.549275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bc217c63-d4ac-472d-be05-71adbd22cc40 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:32.550104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bc217c63-d4ac-472d-be05-71adbd22cc40 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:32.556002 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bc217c63-d4ac-472d-be05-71adbd22cc40 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:32.556485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bc217c63-d4ac-472d-be05-71adbd22cc40 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:32.557244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bc217c63-d4ac-472d-be05-71adbd22cc40 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:32.557675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bc217c63-d4ac-472d-be05-71adbd22cc40 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:32.561352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:32.587190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bc217c63-d4ac-472d-be05-71adbd22cc40 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041988 Jul 20 13:51:32.588021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 312/630] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:51:33.412825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:33.413455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:33.419833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:33.420332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:33.421100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:33.421539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:33.551084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:33.558418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-21c3de65-3e84-48cf-aade-62c4ac9729dc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.149404 Jul 20 13:51:33.558979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 313/631] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:33.598681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f2bbdc4c-8bb3-417f-b6dc-ac33a248908e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:33.599578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f2bbdc4c-8bb3-417f-b6dc-ac33a248908e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:33.605411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2bbdc4c-8bb3-417f-b6dc-ac33a248908e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:33.605852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2bbdc4c-8bb3-417f-b6dc-ac33a248908e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:33.606612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2bbdc4c-8bb3-417f-b6dc-ac33a248908e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:33.607042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2bbdc4c-8bb3-417f-b6dc-ac33a248908e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:33.635694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f2bbdc4c-8bb3-417f-b6dc-ac33a248908e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040776 Jul 20 13:51:33.636846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 314/632] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:51:33.883098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=23 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:33.956269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=29 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:34.574913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:34.575442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:34.582266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:34.582714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:34.583484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:34.583918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:34.720292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:34.728340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bb54d71c-e045-4c12-991b-441194254fc8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.157332 Jul 20 13:51:34.728905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 315/633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:34.733947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ee50d6ab-ada3-42e1-81a7-7bf4a2e50574 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:34.735379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ee50d6ab-ada3-42e1-81a7-7bf4a2e50574 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:34.743693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee50d6ab-ada3-42e1-81a7-7bf4a2e50574 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:34.744413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee50d6ab-ada3-42e1-81a7-7bf4a2e50574 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:34.745570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee50d6ab-ada3-42e1-81a7-7bf4a2e50574 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:34.746236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee50d6ab-ada3-42e1-81a7-7bf4a2e50574 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:34.785986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ee50d6ab-ada3-42e1-81a7-7bf4a2e50574 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055837 Jul 20 13:51:34.786975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 316/634] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:35.745506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:35.746112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:35.752556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:35.752998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:35.753760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:35.754189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:35.881405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:35.888897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a7b34ae2-0f14-4367-b5e8-d4757988b74b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.147215 Jul 20 13:51:35.889400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 317/635] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:35.894067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b9ee292a-2797-4212-897a-b3d63c72f12e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:35.894963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b9ee292a-2797-4212-897a-b3d63c72f12e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:35.900535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9ee292a-2797-4212-897a-b3d63c72f12e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:35.900980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9ee292a-2797-4212-897a-b3d63c72f12e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:35.901738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9ee292a-2797-4212-897a-b3d63c72f12e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:35.902173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9ee292a-2797-4212-897a-b3d63c72f12e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:35.931193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b9ee292a-2797-4212-897a-b3d63c72f12e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040832 Jul 20 13:51:35.931728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 318/636] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:36.905543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:36.906196 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:36.908417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:36.914892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:36.915365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:36.916133 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:36.916595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:37.044938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:37.052325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8bbdbf25-02b9-4655-8c38-8d487a8f4d46 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.150706 Jul 20 13:51:37.052891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 319/637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:37.057523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b256457d-c777-446c-b55f-61541a578007 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:37.058501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b256457d-c777-446c-b55f-61541a578007 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:37.064171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b256457d-c777-446c-b55f-61541a578007 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:37.064651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b256457d-c777-446c-b55f-61541a578007 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:37.065440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b256457d-c777-446c-b55f-61541a578007 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:37.065931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b256457d-c777-446c-b55f-61541a578007 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:37.094548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b256457d-c777-446c-b55f-61541a578007 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040578 Jul 20 13:51:37.095118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 320/638] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:38.068983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:38.069584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:38.075995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:38.076744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:38.077506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:38.077940 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:38.213865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:38.221213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aaf304b0-7679-44ee-a666-9e2f9a56f9a4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1260 microversion: 2.1 time: 0.156193 Jul 20 13:51:38.221773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 321/639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:38.226804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fa6a5724-d26b-49c4-91b6-5d23efee7549 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:38.227701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fa6a5724-d26b-49c4-91b6-5d23efee7549 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:38.233191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa6a5724-d26b-49c4-91b6-5d23efee7549 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:38.233632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa6a5724-d26b-49c4-91b6-5d23efee7549 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:38.234393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa6a5724-d26b-49c4-91b6-5d23efee7549 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:38.234826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fa6a5724-d26b-49c4-91b6-5d23efee7549 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:38.263480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fa6a5724-d26b-49c4-91b6-5d23efee7549 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040691 Jul 20 13:51:38.264033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 322/640] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:39.238620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:39.239306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:39.246194 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:39.246641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:39.247398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:39.247831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:39.377842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:39.386015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-488d3919-c861-430d-ae70-2bb7500ef6d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1444 microversion: 2.1 time: 0.151238 Jul 20 13:51:39.386595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 323/641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:51:39.391140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c526c829-a095-4064-8818-2b7e829da017 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:39.392042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c526c829-a095-4064-8818-2b7e829da017 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:39.398510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c526c829-a095-4064-8818-2b7e829da017 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:39.398896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c526c829-a095-4064-8818-2b7e829da017 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:39.399727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c526c829-a095-4064-8818-2b7e829da017 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:39.400159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c526c829-a095-4064-8818-2b7e829da017 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:39.428559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c526c829-a095-4064-8818-2b7e829da017 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040835 Jul 20 13:51:39.429063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 324/642] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:39.433592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:39.434645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:39.439927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:39.440430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:39.441191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:39.441624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:39.574529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:51:39.582094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61aa6444-ad56-4536-9df7-9b6b07f46aa6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1444 microversion: 2.1 time: 0.152123 Jul 20 13:51:39.582657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 325/643] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:51:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:51:39.820378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-47901534-b74f-4779-bf33-398a8aec0858 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "POST /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.947353 Jul 20 13:51:39.820993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 319/644] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 13:51:23 2022] POST /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba/os-volume_attachments => generated 194 bytes in 15949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:51:40.441811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d8a9b08d-9244-4609-9349-11d5411e74ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:40.442934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d8a9b08d-9244-4609-9349-11d5411e74ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:40.450316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8a9b08d-9244-4609-9349-11d5411e74ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:40.450893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8a9b08d-9244-4609-9349-11d5411e74ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:40.452080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8a9b08d-9244-4609-9349-11d5411e74ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:40.452668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d8a9b08d-9244-4609-9349-11d5411e74ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:40.494165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d8a9b08d-9244-4609-9349-11d5411e74ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056612 Jul 20 13:51:40.498142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 326/645] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:41.507162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2769578c-e29a-44fc-8ce7-acacb9284e00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:41.508500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2769578c-e29a-44fc-8ce7-acacb9284e00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:41.519125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2769578c-e29a-44fc-8ce7-acacb9284e00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:41.519581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2769578c-e29a-44fc-8ce7-acacb9284e00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:41.520394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2769578c-e29a-44fc-8ce7-acacb9284e00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:41.521356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2769578c-e29a-44fc-8ce7-acacb9284e00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:41.557306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2769578c-e29a-44fc-8ce7-acacb9284e00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055104 Jul 20 13:51:41.557872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 320/646] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:41.562557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-f25735c3-29ec-4554-8e36-43e637ebbd89 req-8c80d516-f2b6-4e02-a935-53f7a58e9eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f9c037-a55c-46c4-aae3-4929db5f0193", "tag": "f1fd1db3-83b1-4e8d-a486-5ac886455b89"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:51:41.570957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f25735c3-29ec-4554-8e36-43e637ebbd89 req-8c80d516-f2b6-4e02-a935-53f7a58e9eb0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:41.571489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f25735c3-29ec-4554-8e36-43e637ebbd89 req-8c80d516-f2b6-4e02-a935-53f7a58e9eb0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:41.582777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-f25735c3-29ec-4554-8e36-43e637ebbd89 req-8c80d516-f2b6-4e02-a935-53f7a58e9eb0 service nova] Creating event network-changed:f1fd1db3-83b1-4e8d-a486-5ac886455b89 for instance 36f9c037-a55c-46c4-aae3-4929db5f0193 on hv-cinder-81914 Jul 20 13:51:41.589078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-f25735c3-29ec-4554-8e36-43e637ebbd89 req-8c80d516-f2b6-4e02-a935-53f7a58e9eb0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030171 Jul 20 13:51:41.589677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 327/647] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:51:42.569846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8d6e4eea-c294-42ea-aa84-35985f92e855 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:42.570766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8d6e4eea-c294-42ea-aa84-35985f92e855 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:42.577312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8d6e4eea-c294-42ea-aa84-35985f92e855 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:42.577926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8d6e4eea-c294-42ea-aa84-35985f92e855 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:42.578671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8d6e4eea-c294-42ea-aa84-35985f92e855 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:42.579163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8d6e4eea-c294-42ea-aa84-35985f92e855 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:42.607311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8d6e4eea-c294-42ea-aa84-35985f92e855 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042198 Jul 20 13:51:42.607873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 321/648] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:43.619847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-16972411-652e-4c22-8ad9-aee938d27c61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:43.620869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-16972411-652e-4c22-8ad9-aee938d27c61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:43.627149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16972411-652e-4c22-8ad9-aee938d27c61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:43.627603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16972411-652e-4c22-8ad9-aee938d27c61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:43.628403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16972411-652e-4c22-8ad9-aee938d27c61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:43.628838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16972411-652e-4c22-8ad9-aee938d27c61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:43.658684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-16972411-652e-4c22-8ad9-aee938d27c61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044068 Jul 20 13:51:43.659237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 328/649] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:44.670822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-64f73d4f-ee67-4be5-b212-7be0419b4b4b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:44.671805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-64f73d4f-ee67-4be5-b212-7be0419b4b4b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:44.678765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64f73d4f-ee67-4be5-b212-7be0419b4b4b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:44.679244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64f73d4f-ee67-4be5-b212-7be0419b4b4b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:44.680040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64f73d4f-ee67-4be5-b212-7be0419b4b4b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:44.680504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64f73d4f-ee67-4be5-b212-7be0419b4b4b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:44.713249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-64f73d4f-ee67-4be5-b212-7be0419b4b4b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046418 Jul 20 13:51:44.713910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 322/650] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:51:45.724584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-863f1d1d-a0e1-4281-b20f-90f0ba529822 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:45.725502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-863f1d1d-a0e1-4281-b20f-90f0ba529822 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:45.731877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-863f1d1d-a0e1-4281-b20f-90f0ba529822 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:45.732359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-863f1d1d-a0e1-4281-b20f-90f0ba529822 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:45.733118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-863f1d1d-a0e1-4281-b20f-90f0ba529822 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:45.733549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-863f1d1d-a0e1-4281-b20f-90f0ba529822 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:45.748122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:45.763279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-863f1d1d-a0e1-4281-b20f-90f0ba529822 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043268 Jul 20 13:51:45.763822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 329/651] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:46.774851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-68c9c6e5-7393-4fd3-8f10-43c4cba5946c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:46.775754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-68c9c6e5-7393-4fd3-8f10-43c4cba5946c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:46.782072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68c9c6e5-7393-4fd3-8f10-43c4cba5946c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:46.782513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68c9c6e5-7393-4fd3-8f10-43c4cba5946c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:46.783263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68c9c6e5-7393-4fd3-8f10-43c4cba5946c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:46.783691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68c9c6e5-7393-4fd3-8f10-43c4cba5946c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:46.812687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-68c9c6e5-7393-4fd3-8f10-43c4cba5946c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041718 Jul 20 13:51:46.813248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 323/652] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:47.824824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-949b48fd-53ee-44fe-b3e5-651c04d40410 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:47.825773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-949b48fd-53ee-44fe-b3e5-651c04d40410 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:47.832537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-949b48fd-53ee-44fe-b3e5-651c04d40410 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:47.832986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-949b48fd-53ee-44fe-b3e5-651c04d40410 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:47.833746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-949b48fd-53ee-44fe-b3e5-651c04d40410 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:47.834178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-949b48fd-53ee-44fe-b3e5-651c04d40410 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:47.862021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-949b48fd-53ee-44fe-b3e5-651c04d40410 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041127 Jul 20 13:51:47.862643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 330/653] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:48.875201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e3e918e7-c4f4-4202-9759-5b923f9dd62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:48.876210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e3e918e7-c4f4-4202-9759-5b923f9dd62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:48.883189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e918e7-c4f4-4202-9759-5b923f9dd62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:48.883639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e918e7-c4f4-4202-9759-5b923f9dd62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:48.884436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e918e7-c4f4-4202-9759-5b923f9dd62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:48.884873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e918e7-c4f4-4202-9759-5b923f9dd62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:48.913901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e3e918e7-c4f4-4202-9759-5b923f9dd62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Jul 20 13:51:48.914452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 324/654] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:49.925518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ec9c3993-901d-4100-ae15-c66c7f1f17c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:49.926434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ec9c3993-901d-4100-ae15-c66c7f1f17c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:49.933647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec9c3993-901d-4100-ae15-c66c7f1f17c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:49.934092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec9c3993-901d-4100-ae15-c66c7f1f17c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:49.934866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec9c3993-901d-4100-ae15-c66c7f1f17c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:49.935299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec9c3993-901d-4100-ae15-c66c7f1f17c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:49.965769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ec9c3993-901d-4100-ae15-c66c7f1f17c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044210 Jul 20 13:51:49.968293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 331/655] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:50.978686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1a0d1a24-08f1-4fae-8da6-6bb687108b64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:50.979591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1a0d1a24-08f1-4fae-8da6-6bb687108b64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:50.985968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a0d1a24-08f1-4fae-8da6-6bb687108b64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:50.986404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a0d1a24-08f1-4fae-8da6-6bb687108b64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:50.987159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a0d1a24-08f1-4fae-8da6-6bb687108b64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:50.987587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a0d1a24-08f1-4fae-8da6-6bb687108b64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:51.015527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1a0d1a24-08f1-4fae-8da6-6bb687108b64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041529 Jul 20 13:51:51.016077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 325/656] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:52.027333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-967393ad-e95e-42b1-a84f-caae28e11d1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:52.028273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-967393ad-e95e-42b1-a84f-caae28e11d1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:52.034897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-967393ad-e95e-42b1-a84f-caae28e11d1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:52.035343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-967393ad-e95e-42b1-a84f-caae28e11d1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:52.036774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-967393ad-e95e-42b1-a84f-caae28e11d1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:52.037253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-967393ad-e95e-42b1-a84f-caae28e11d1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:52.065753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-967393ad-e95e-42b1-a84f-caae28e11d1c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042315 Jul 20 13:51:52.066302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 332/657] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:53.077509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d48ada62-3bdf-452a-811f-869afcc5a0a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:53.078420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d48ada62-3bdf-452a-811f-869afcc5a0a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:53.085532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d48ada62-3bdf-452a-811f-869afcc5a0a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:53.085970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d48ada62-3bdf-452a-811f-869afcc5a0a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:53.086722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d48ada62-3bdf-452a-811f-869afcc5a0a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:53.087147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d48ada62-3bdf-452a-811f-869afcc5a0a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:53.115007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d48ada62-3bdf-452a-811f-869afcc5a0a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041739 Jul 20 13:51:53.115556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 326/658] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:54.126443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-57d149ca-09a6-4d3d-a2d2-741816d7c834 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:54.127357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-57d149ca-09a6-4d3d-a2d2-741816d7c834 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:54.134508 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57d149ca-09a6-4d3d-a2d2-741816d7c834 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:54.134957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57d149ca-09a6-4d3d-a2d2-741816d7c834 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:54.135746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57d149ca-09a6-4d3d-a2d2-741816d7c834 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:54.136245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57d149ca-09a6-4d3d-a2d2-741816d7c834 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:54.164943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-57d149ca-09a6-4d3d-a2d2-741816d7c834 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042442 Jul 20 13:51:54.165487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 333/659] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:55.176324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-667d4add-984a-4651-8758-97983ed9030d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:55.177728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-667d4add-984a-4651-8758-97983ed9030d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:55.184052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-667d4add-984a-4651-8758-97983ed9030d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:55.184523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-667d4add-984a-4651-8758-97983ed9030d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:55.185273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-667d4add-984a-4651-8758-97983ed9030d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:55.185704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-667d4add-984a-4651-8758-97983ed9030d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:55.214204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-667d4add-984a-4651-8758-97983ed9030d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041811 Jul 20 13:51:55.214736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 327/660] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:56.225586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46d96426-6a26-4c51-abea-85096b407da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:56.226495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46d96426-6a26-4c51-abea-85096b407da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:56.232875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46d96426-6a26-4c51-abea-85096b407da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:56.233322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46d96426-6a26-4c51-abea-85096b407da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:56.234081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46d96426-6a26-4c51-abea-85096b407da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:56.234517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46d96426-6a26-4c51-abea-85096b407da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:56.262787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46d96426-6a26-4c51-abea-85096b407da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041091 Jul 20 13:51:56.263328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 334/661] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:57.274545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e84b81d7-0e0a-4e31-aa49-17f9cc7be364 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:57.276083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e84b81d7-0e0a-4e31-aa49-17f9cc7be364 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:57.282747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84b81d7-0e0a-4e31-aa49-17f9cc7be364 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:57.283199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84b81d7-0e0a-4e31-aa49-17f9cc7be364 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:57.284062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84b81d7-0e0a-4e31-aa49-17f9cc7be364 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:57.284595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84b81d7-0e0a-4e31-aa49-17f9cc7be364 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:57.314816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e84b81d7-0e0a-4e31-aa49-17f9cc7be364 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044498 Jul 20 13:51:57.315670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 328/662] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:58.327262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-589b4679-0cba-4f7e-9162-c6e34d190a22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:58.328179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-589b4679-0cba-4f7e-9162-c6e34d190a22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:58.334097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-589b4679-0cba-4f7e-9162-c6e34d190a22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:58.334545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-589b4679-0cba-4f7e-9162-c6e34d190a22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:58.335306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-589b4679-0cba-4f7e-9162-c6e34d190a22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:58.335740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-589b4679-0cba-4f7e-9162-c6e34d190a22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:58.364552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-589b4679-0cba-4f7e-9162-c6e34d190a22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041537 Jul 20 13:51:58.365689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 335/663] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:51:59.376305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3794f373-ee31-45cb-a266-e882f72fafc9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:51:59.377227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3794f373-ee31-45cb-a266-e882f72fafc9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:51:59.384157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3794f373-ee31-45cb-a266-e882f72fafc9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:59.384820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3794f373-ee31-45cb-a266-e882f72fafc9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:59.385594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3794f373-ee31-45cb-a266-e882f72fafc9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:51:59.386030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3794f373-ee31-45cb-a266-e882f72fafc9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:51:59.414542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3794f373-ee31-45cb-a266-e882f72fafc9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042167 Jul 20 13:51:59.415022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 329/664] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:51:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:00.426178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b8509b50-d0ea-4f62-9f52-6da0bb932ace tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:00.427092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b8509b50-d0ea-4f62-9f52-6da0bb932ace tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:00.434308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8509b50-d0ea-4f62-9f52-6da0bb932ace tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:00.434754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8509b50-d0ea-4f62-9f52-6da0bb932ace tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:00.435515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8509b50-d0ea-4f62-9f52-6da0bb932ace tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:00.435945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8509b50-d0ea-4f62-9f52-6da0bb932ace tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:00.464712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b8509b50-d0ea-4f62-9f52-6da0bb932ace tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042422 Jul 20 13:52:00.465245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 336/665] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:01.476791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1c4476ab-352d-435d-b384-94b98b1c6494 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:01.477709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1c4476ab-352d-435d-b384-94b98b1c6494 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:01.483799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c4476ab-352d-435d-b384-94b98b1c6494 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:01.484276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c4476ab-352d-435d-b384-94b98b1c6494 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:01.485048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c4476ab-352d-435d-b384-94b98b1c6494 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:01.485486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c4476ab-352d-435d-b384-94b98b1c6494 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:01.514567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1c4476ab-352d-435d-b384-94b98b1c6494 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042358 Jul 20 13:52:01.515151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 330/666] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:02.526158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c10d32ce-9115-4d7e-a37f-d9572a607afe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:02.527076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c10d32ce-9115-4d7e-a37f-d9572a607afe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:02.533644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c10d32ce-9115-4d7e-a37f-d9572a607afe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:02.534133 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c10d32ce-9115-4d7e-a37f-d9572a607afe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:02.534889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c10d32ce-9115-4d7e-a37f-d9572a607afe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:02.535325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c10d32ce-9115-4d7e-a37f-d9572a607afe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:02.563899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c10d32ce-9115-4d7e-a37f-d9572a607afe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041712 Jul 20 13:52:02.564469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 337/667] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:03.575546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e76b382d-4ed5-482a-b4a7-af2ccbb48783 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:03.576875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e76b382d-4ed5-482a-b4a7-af2ccbb48783 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:03.583328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e76b382d-4ed5-482a-b4a7-af2ccbb48783 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:03.583768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e76b382d-4ed5-482a-b4a7-af2ccbb48783 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:03.585231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e76b382d-4ed5-482a-b4a7-af2ccbb48783 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:03.585661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e76b382d-4ed5-482a-b4a7-af2ccbb48783 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:03.614657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e76b382d-4ed5-482a-b4a7-af2ccbb48783 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042975 Jul 20 13:52:03.615216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 331/668] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:04.626411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6a155d4a-6778-413f-84c0-8fcd6acdbbc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:04.627355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6a155d4a-6778-413f-84c0-8fcd6acdbbc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:04.634302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a155d4a-6778-413f-84c0-8fcd6acdbbc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:04.634628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a155d4a-6778-413f-84c0-8fcd6acdbbc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:04.635551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a155d4a-6778-413f-84c0-8fcd6acdbbc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:04.635888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a155d4a-6778-413f-84c0-8fcd6acdbbc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:04.665667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6a155d4a-6778-413f-84c0-8fcd6acdbbc6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043217 Jul 20 13:52:04.666218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 338/669] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:05.676816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3907c7fa-fe5d-4b35-b66b-d0fb6084c527 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:05.677744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3907c7fa-fe5d-4b35-b66b-d0fb6084c527 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:05.680994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=25 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:05.686382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3907c7fa-fe5d-4b35-b66b-d0fb6084c527 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:05.686824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3907c7fa-fe5d-4b35-b66b-d0fb6084c527 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:05.687590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3907c7fa-fe5d-4b35-b66b-d0fb6084c527 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:05.688016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3907c7fa-fe5d-4b35-b66b-d0fb6084c527 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:05.691834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:05.721079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3907c7fa-fe5d-4b35-b66b-d0fb6084c527 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048415 Jul 20 13:52:05.721652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 332/670] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:06.733035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d43731ff-0697-4243-83ce-2c265f7ad1dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:06.733955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d43731ff-0697-4243-83ce-2c265f7ad1dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:06.740510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d43731ff-0697-4243-83ce-2c265f7ad1dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:06.741577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d43731ff-0697-4243-83ce-2c265f7ad1dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:06.742342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d43731ff-0697-4243-83ce-2c265f7ad1dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:06.742776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d43731ff-0697-4243-83ce-2c265f7ad1dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:06.770627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d43731ff-0697-4243-83ce-2c265f7ad1dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041591 Jul 20 13:52:06.771165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 339/671] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:07.782372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1abc0d19-e466-4d4a-9ecd-bf813f7cde2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:07.783276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1abc0d19-e466-4d4a-9ecd-bf813f7cde2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:07.789711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1abc0d19-e466-4d4a-9ecd-bf813f7cde2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:07.790150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1abc0d19-e466-4d4a-9ecd-bf813f7cde2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:07.790906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1abc0d19-e466-4d4a-9ecd-bf813f7cde2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:07.791334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1abc0d19-e466-4d4a-9ecd-bf813f7cde2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:07.820514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1abc0d19-e466-4d4a-9ecd-bf813f7cde2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042114 Jul 20 13:52:07.821063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 333/672] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:08.832437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b1ed82ed-03cc-4e20-8b26-8ba3f5896d67 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:08.833354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b1ed82ed-03cc-4e20-8b26-8ba3f5896d67 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:08.836296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=42 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:08.841610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1ed82ed-03cc-4e20-8b26-8ba3f5896d67 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:08.842059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1ed82ed-03cc-4e20-8b26-8ba3f5896d67 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:08.842829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1ed82ed-03cc-4e20-8b26-8ba3f5896d67 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:08.843263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1ed82ed-03cc-4e20-8b26-8ba3f5896d67 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:08.871561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b1ed82ed-03cc-4e20-8b26-8ba3f5896d67 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043152 Jul 20 13:52:08.872116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 340/673] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:09.883913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b744851e-3b11-441f-aa1a-485baf373698 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:09.884865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b744851e-3b11-441f-aa1a-485baf373698 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:09.891154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b744851e-3b11-441f-aa1a-485baf373698 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:09.891602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b744851e-3b11-441f-aa1a-485baf373698 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:09.892380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b744851e-3b11-441f-aa1a-485baf373698 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:09.892808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b744851e-3b11-441f-aa1a-485baf373698 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:09.921855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b744851e-3b11-441f-aa1a-485baf373698 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042545 Jul 20 13:52:09.922424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 334/674] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:10.932880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7d6ea97e-1407-477b-86a4-035f5be7299c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:10.933791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7d6ea97e-1407-477b-86a4-035f5be7299c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:10.940206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6ea97e-1407-477b-86a4-035f5be7299c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:10.940656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6ea97e-1407-477b-86a4-035f5be7299c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:10.941410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6ea97e-1407-477b-86a4-035f5be7299c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:10.941838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6ea97e-1407-477b-86a4-035f5be7299c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:10.971293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7d6ea97e-1407-477b-86a4-035f5be7299c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042420 Jul 20 13:52:10.971831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 341/675] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:11.982950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1f429304-bac4-47a1-96c0-c8c11e4da0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:11.983860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1f429304-bac4-47a1-96c0-c8c11e4da0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:11.990257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f429304-bac4-47a1-96c0-c8c11e4da0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:11.990695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f429304-bac4-47a1-96c0-c8c11e4da0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:11.991448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f429304-bac4-47a1-96c0-c8c11e4da0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:11.991873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f429304-bac4-47a1-96c0-c8c11e4da0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:12.019906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1f429304-bac4-47a1-96c0-c8c11e4da0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040961 Jul 20 13:52:12.020469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 335/676] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:13.032724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1e0270fd-8120-4304-aa4b-6c714c7d8313 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:13.033677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1e0270fd-8120-4304-aa4b-6c714c7d8313 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:13.040860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0270fd-8120-4304-aa4b-6c714c7d8313 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:13.041309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0270fd-8120-4304-aa4b-6c714c7d8313 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:13.042076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0270fd-8120-4304-aa4b-6c714c7d8313 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:13.042569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0270fd-8120-4304-aa4b-6c714c7d8313 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:13.070711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1e0270fd-8120-4304-aa4b-6c714c7d8313 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042053 Jul 20 13:52:13.071278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 342/677] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:14.180250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7175a9a2-92ad-4016-b970-a13fb548f8a9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:14.181166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7175a9a2-92ad-4016-b970-a13fb548f8a9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:14.187087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7175a9a2-92ad-4016-b970-a13fb548f8a9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:14.187540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7175a9a2-92ad-4016-b970-a13fb548f8a9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:14.188339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7175a9a2-92ad-4016-b970-a13fb548f8a9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:14.188773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7175a9a2-92ad-4016-b970-a13fb548f8a9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:14.217881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7175a9a2-92ad-4016-b970-a13fb548f8a9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139268 Jul 20 13:52:14.218450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 336/678] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:52:14.251922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:52:14.252085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 13:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:52:15.229529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1a2eba91-029f-4668-b034-fc00627735b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:15.230382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1a2eba91-029f-4668-b034-fc00627735b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:15.236886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a2eba91-029f-4668-b034-fc00627735b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:15.237321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a2eba91-029f-4668-b034-fc00627735b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:15.238105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a2eba91-029f-4668-b034-fc00627735b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:15.238530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a2eba91-029f-4668-b034-fc00627735b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:15.268114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1a2eba91-029f-4668-b034-fc00627735b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042582 Jul 20 13:52:15.268703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 343/679] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:16.280301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bf907010-cfb3-4566-a9cd-64a3658609f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:16.281200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bf907010-cfb3-4566-a9cd-64a3658609f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:16.288312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf907010-cfb3-4566-a9cd-64a3658609f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:16.288761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf907010-cfb3-4566-a9cd-64a3658609f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:16.289516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf907010-cfb3-4566-a9cd-64a3658609f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:16.289968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf907010-cfb3-4566-a9cd-64a3658609f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:16.318990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bf907010-cfb3-4566-a9cd-64a3658609f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042719 Jul 20 13:52:16.319543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 337/680] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:17.331340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6eb96fe7-df3d-4661-a5fb-5be962a97508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:17.332291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6eb96fe7-df3d-4661-a5fb-5be962a97508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:17.338748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eb96fe7-df3d-4661-a5fb-5be962a97508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:17.339207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eb96fe7-df3d-4661-a5fb-5be962a97508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:17.339953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eb96fe7-df3d-4661-a5fb-5be962a97508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:17.340420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eb96fe7-df3d-4661-a5fb-5be962a97508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:17.342721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=88 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:17.369975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6eb96fe7-df3d-4661-a5fb-5be962a97508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042671 Jul 20 13:52:17.370712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 344/681] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:18.381762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6ce71ecf-e45d-4f54-93f7-e3ce8a2ef0a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:18.382682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6ce71ecf-e45d-4f54-93f7-e3ce8a2ef0a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:18.389006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ce71ecf-e45d-4f54-93f7-e3ce8a2ef0a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:18.389463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ce71ecf-e45d-4f54-93f7-e3ce8a2ef0a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:18.390244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ce71ecf-e45d-4f54-93f7-e3ce8a2ef0a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:18.390681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ce71ecf-e45d-4f54-93f7-e3ce8a2ef0a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:18.420763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6ce71ecf-e45d-4f54-93f7-e3ce8a2ef0a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042965 Jul 20 13:52:18.421326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 338/682] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:19.432813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-330b25bf-19e5-4638-a1b2-ed356c32f12b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:19.433767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-330b25bf-19e5-4638-a1b2-ed356c32f12b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:19.440184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-330b25bf-19e5-4638-a1b2-ed356c32f12b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:19.440656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-330b25bf-19e5-4638-a1b2-ed356c32f12b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:19.441422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-330b25bf-19e5-4638-a1b2-ed356c32f12b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:19.441854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-330b25bf-19e5-4638-a1b2-ed356c32f12b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:19.471902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-330b25bf-19e5-4638-a1b2-ed356c32f12b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043277 Jul 20 13:52:19.472493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 345/683] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:20.483554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8bfda6e9-ae06-4c93-90b1-6cf9954464f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:20.484496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8bfda6e9-ae06-4c93-90b1-6cf9954464f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:20.490903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bfda6e9-ae06-4c93-90b1-6cf9954464f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:20.491345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bfda6e9-ae06-4c93-90b1-6cf9954464f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:20.492152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bfda6e9-ae06-4c93-90b1-6cf9954464f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:20.492644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bfda6e9-ae06-4c93-90b1-6cf9954464f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:20.520880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8bfda6e9-ae06-4c93-90b1-6cf9954464f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041279 Jul 20 13:52:20.521440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 339/684] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:21.533452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5dc56159-1236-478c-a965-3ab380c1faff tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:21.534405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5dc56159-1236-478c-a965-3ab380c1faff tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:21.541766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5dc56159-1236-478c-a965-3ab380c1faff tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:21.542210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5dc56159-1236-478c-a965-3ab380c1faff tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:21.542983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5dc56159-1236-478c-a965-3ab380c1faff tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:21.543415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5dc56159-1236-478c-a965-3ab380c1faff tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:21.579806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5dc56159-1236-478c-a965-3ab380c1faff tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050562 Jul 20 13:52:21.580575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 346/685] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:22.591112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2f72300a-388b-4308-ae88-5f0a18f677a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:22.592044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2f72300a-388b-4308-ae88-5f0a18f677a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:22.598439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f72300a-388b-4308-ae88-5f0a18f677a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:22.598874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f72300a-388b-4308-ae88-5f0a18f677a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:22.599618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f72300a-388b-4308-ae88-5f0a18f677a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:22.600040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f72300a-388b-4308-ae88-5f0a18f677a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:22.628727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2f72300a-388b-4308-ae88-5f0a18f677a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041526 Jul 20 13:52:22.629589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 340/686] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:23.640110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2bf65409-5b20-4c3b-ad28-b37a3a279c96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:23.641102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2bf65409-5b20-4c3b-ad28-b37a3a279c96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:23.647677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bf65409-5b20-4c3b-ad28-b37a3a279c96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:23.648658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bf65409-5b20-4c3b-ad28-b37a3a279c96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:23.649438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bf65409-5b20-4c3b-ad28-b37a3a279c96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:23.649879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bf65409-5b20-4c3b-ad28-b37a3a279c96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:23.679060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2bf65409-5b20-4c3b-ad28-b37a3a279c96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042907 Jul 20 13:52:23.679619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 347/687] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:24.690840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8cdf0c6b-970c-4971-adf4-4867f740e717 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:24.691782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8cdf0c6b-970c-4971-adf4-4867f740e717 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:24.698417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cdf0c6b-970c-4971-adf4-4867f740e717 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:24.698864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cdf0c6b-970c-4971-adf4-4867f740e717 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:24.699650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cdf0c6b-970c-4971-adf4-4867f740e717 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:24.700077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cdf0c6b-970c-4971-adf4-4867f740e717 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:24.728998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8cdf0c6b-970c-4971-adf4-4867f740e717 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042085 Jul 20 13:52:24.729557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 341/688] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:25.740035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7cc8e59f-12ff-4590-805f-d193fc5a7bdd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:25.740998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7cc8e59f-12ff-4590-805f-d193fc5a7bdd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:25.747880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7cc8e59f-12ff-4590-805f-d193fc5a7bdd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:25.748360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7cc8e59f-12ff-4590-805f-d193fc5a7bdd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:25.749122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7cc8e59f-12ff-4590-805f-d193fc5a7bdd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:25.749554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7cc8e59f-12ff-4590-805f-d193fc5a7bdd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:25.777972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7cc8e59f-12ff-4590-805f-d193fc5a7bdd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041944 Jul 20 13:52:25.778522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 348/689] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:26.789513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-674349ef-b75e-473d-9cd7-4d3f07be8568 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:26.790931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-674349ef-b75e-473d-9cd7-4d3f07be8568 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:26.797345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674349ef-b75e-473d-9cd7-4d3f07be8568 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:26.797815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674349ef-b75e-473d-9cd7-4d3f07be8568 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:26.798576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674349ef-b75e-473d-9cd7-4d3f07be8568 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:26.799008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674349ef-b75e-473d-9cd7-4d3f07be8568 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:26.827619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-674349ef-b75e-473d-9cd7-4d3f07be8568 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042059 Jul 20 13:52:26.828154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 342/690] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:27.839858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aa07e176-f0dc-460c-b41a-99f0f87fda23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:27.840809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aa07e176-f0dc-460c-b41a-99f0f87fda23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:27.847031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa07e176-f0dc-460c-b41a-99f0f87fda23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:27.847481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa07e176-f0dc-460c-b41a-99f0f87fda23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:27.848273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa07e176-f0dc-460c-b41a-99f0f87fda23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:27.848710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa07e176-f0dc-460c-b41a-99f0f87fda23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:27.877251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aa07e176-f0dc-460c-b41a-99f0f87fda23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041959 Jul 20 13:52:27.877820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 349/691] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:28.889748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-68d649b6-e39e-4b44-897a-78a943cd3ae1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:28.890583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-68d649b6-e39e-4b44-897a-78a943cd3ae1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:28.897055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68d649b6-e39e-4b44-897a-78a943cd3ae1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:28.897499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68d649b6-e39e-4b44-897a-78a943cd3ae1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:28.898259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68d649b6-e39e-4b44-897a-78a943cd3ae1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:28.898692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68d649b6-e39e-4b44-897a-78a943cd3ae1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:28.927213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-68d649b6-e39e-4b44-897a-78a943cd3ae1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041538 Jul 20 13:52:28.927749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 343/692] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:29.938877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-afaa114f-5f87-4bad-b877-718011d360f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:29.939789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-afaa114f-5f87-4bad-b877-718011d360f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:29.946652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afaa114f-5f87-4bad-b877-718011d360f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:29.947100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afaa114f-5f87-4bad-b877-718011d360f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:29.947857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afaa114f-5f87-4bad-b877-718011d360f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:29.948310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afaa114f-5f87-4bad-b877-718011d360f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:29.976780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-afaa114f-5f87-4bad-b877-718011d360f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041930 Jul 20 13:52:29.977321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 350/693] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:30.988683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d0ea8b5a-5186-407d-a031-76c9846fbf23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:30.989586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d0ea8b5a-5186-407d-a031-76c9846fbf23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:30.995971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d0ea8b5a-5186-407d-a031-76c9846fbf23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:30.996456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d0ea8b5a-5186-407d-a031-76c9846fbf23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:30.997210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d0ea8b5a-5186-407d-a031-76c9846fbf23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:30.997642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d0ea8b5a-5186-407d-a031-76c9846fbf23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:31.025863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d0ea8b5a-5186-407d-a031-76c9846fbf23 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041273 Jul 20 13:52:31.026399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 344/694] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:32.037594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-99636f11-4859-43be-9018-0a07af64c203 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:32.038516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-99636f11-4859-43be-9018-0a07af64c203 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:32.045473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99636f11-4859-43be-9018-0a07af64c203 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:32.045924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99636f11-4859-43be-9018-0a07af64c203 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:32.046694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99636f11-4859-43be-9018-0a07af64c203 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:32.047131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-99636f11-4859-43be-9018-0a07af64c203 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:32.075913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-99636f11-4859-43be-9018-0a07af64c203 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042057 Jul 20 13:52:32.076505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 351/695] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:33.086774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-56e7a2c2-7502-4e94-9ce4-05a301e45bf3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:33.087722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-56e7a2c2-7502-4e94-9ce4-05a301e45bf3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:33.094133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e7a2c2-7502-4e94-9ce4-05a301e45bf3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:33.094571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e7a2c2-7502-4e94-9ce4-05a301e45bf3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:33.095924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e7a2c2-7502-4e94-9ce4-05a301e45bf3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:33.096399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e7a2c2-7502-4e94-9ce4-05a301e45bf3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:33.125435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-56e7a2c2-7502-4e94-9ce4-05a301e45bf3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042643 Jul 20 13:52:33.125974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 345/696] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:34.137156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-55509990-2cf6-405e-888f-2ee5633c40ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:34.138072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-55509990-2cf6-405e-888f-2ee5633c40ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:34.144615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-55509990-2cf6-405e-888f-2ee5633c40ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:34.145060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-55509990-2cf6-405e-888f-2ee5633c40ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:34.145824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-55509990-2cf6-405e-888f-2ee5633c40ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:34.146263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-55509990-2cf6-405e-888f-2ee5633c40ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:34.174511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-55509990-2cf6-405e-888f-2ee5633c40ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041483 Jul 20 13:52:34.175049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 352/697] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:35.187184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0c721c4e-06ea-4e6b-9038-a3a9a928b64b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:35.188150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0c721c4e-06ea-4e6b-9038-a3a9a928b64b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:35.194646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c721c4e-06ea-4e6b-9038-a3a9a928b64b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:35.195029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c721c4e-06ea-4e6b-9038-a3a9a928b64b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:35.195775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c721c4e-06ea-4e6b-9038-a3a9a928b64b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:35.196217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c721c4e-06ea-4e6b-9038-a3a9a928b64b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:35.224440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0c721c4e-06ea-4e6b-9038-a3a9a928b64b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041863 Jul 20 13:52:35.224976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 346/698] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:36.235979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ac8f17aa-4d1f-443b-87b9-07ba19a78786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:36.236910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ac8f17aa-4d1f-443b-87b9-07ba19a78786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:36.243336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac8f17aa-4d1f-443b-87b9-07ba19a78786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:36.243779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac8f17aa-4d1f-443b-87b9-07ba19a78786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:36.244565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac8f17aa-4d1f-443b-87b9-07ba19a78786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:36.245003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac8f17aa-4d1f-443b-87b9-07ba19a78786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:36.273172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ac8f17aa-4d1f-443b-87b9-07ba19a78786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041284 Jul 20 13:52:36.273716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 353/699] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:52:37.285668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0fb4cb17-dc5a-4168-ab80-85bbcd09343c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:37.286610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0fb4cb17-dc5a-4168-ab80-85bbcd09343c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:37.288923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=30 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:37.294733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb4cb17-dc5a-4168-ab80-85bbcd09343c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:37.295181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb4cb17-dc5a-4168-ab80-85bbcd09343c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:37.295940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb4cb17-dc5a-4168-ab80-85bbcd09343c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:37.296488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb4cb17-dc5a-4168-ab80-85bbcd09343c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:37.300155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=90 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:37.326262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0fb4cb17-dc5a-4168-ab80-85bbcd09343c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044654 Jul 20 13:52:37.326814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 347/700] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:52:38.338146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8edb838f-6af7-49cc-998c-a91a53592a70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:38.338982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8edb838f-6af7-49cc-998c-a91a53592a70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:38.346214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edb838f-6af7-49cc-998c-a91a53592a70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:38.346712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edb838f-6af7-49cc-998c-a91a53592a70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:38.347498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edb838f-6af7-49cc-998c-a91a53592a70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:38.347923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edb838f-6af7-49cc-998c-a91a53592a70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:38.376208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8edb838f-6af7-49cc-998c-a91a53592a70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042131 Jul 20 13:52:38.376764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 354/701] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:39.387518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-090d1751-9116-4948-bccf-c9badfa5e516 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:39.388473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-090d1751-9116-4948-bccf-c9badfa5e516 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:39.394987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-090d1751-9116-4948-bccf-c9badfa5e516 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:39.395432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-090d1751-9116-4948-bccf-c9badfa5e516 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:39.396206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-090d1751-9116-4948-bccf-c9badfa5e516 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:39.396644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-090d1751-9116-4948-bccf-c9badfa5e516 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:39.424953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-090d1751-9116-4948-bccf-c9badfa5e516 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041483 Jul 20 13:52:39.425525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 348/702] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:40.436669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-68c933d3-844d-4589-a743-25d9efbfecb1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:40.437621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-68c933d3-844d-4589-a743-25d9efbfecb1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:40.439889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=30 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:40.445238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68c933d3-844d-4589-a743-25d9efbfecb1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:40.445687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68c933d3-844d-4589-a743-25d9efbfecb1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:40.446479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68c933d3-844d-4589-a743-25d9efbfecb1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:40.446916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68c933d3-844d-4589-a743-25d9efbfecb1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:40.475741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-68c933d3-844d-4589-a743-25d9efbfecb1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043784 Jul 20 13:52:40.476308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 355/703] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:41.487644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-45f5588c-8541-4748-968e-c9025922b2f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:41.488701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-45f5588c-8541-4748-968e-c9025922b2f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:41.496139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45f5588c-8541-4748-968e-c9025922b2f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:41.496632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45f5588c-8541-4748-968e-c9025922b2f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:41.497405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45f5588c-8541-4748-968e-c9025922b2f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:41.497841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45f5588c-8541-4748-968e-c9025922b2f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:41.527491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-45f5588c-8541-4748-968e-c9025922b2f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043786 Jul 20 13:52:41.528242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 349/704] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:42.539457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5de3f323-41fe-4834-96f3-e4a2d3445db3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:42.540404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5de3f323-41fe-4834-96f3-e4a2d3445db3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:42.547542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5de3f323-41fe-4834-96f3-e4a2d3445db3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:42.547991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5de3f323-41fe-4834-96f3-e4a2d3445db3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:42.548795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5de3f323-41fe-4834-96f3-e4a2d3445db3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:42.549231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5de3f323-41fe-4834-96f3-e4a2d3445db3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:42.579324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5de3f323-41fe-4834-96f3-e4a2d3445db3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043907 Jul 20 13:52:42.579885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 356/705] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:43.591118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f202cfe5-c20b-4cd1-9599-dea074202fa3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:43.592593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f202cfe5-c20b-4cd1-9599-dea074202fa3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:43.599470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f202cfe5-c20b-4cd1-9599-dea074202fa3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:43.599920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f202cfe5-c20b-4cd1-9599-dea074202fa3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:43.600716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f202cfe5-c20b-4cd1-9599-dea074202fa3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:43.601151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f202cfe5-c20b-4cd1-9599-dea074202fa3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:43.630215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f202cfe5-c20b-4cd1-9599-dea074202fa3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043091 Jul 20 13:52:43.630772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 350/706] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:44.641881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f51fee19-67c9-4012-b5ba-3e126754f2ae tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:44.642834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f51fee19-67c9-4012-b5ba-3e126754f2ae tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:44.649440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f51fee19-67c9-4012-b5ba-3e126754f2ae tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:44.649891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f51fee19-67c9-4012-b5ba-3e126754f2ae tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:44.650662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f51fee19-67c9-4012-b5ba-3e126754f2ae tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:44.651095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f51fee19-67c9-4012-b5ba-3e126754f2ae tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:44.679734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f51fee19-67c9-4012-b5ba-3e126754f2ae tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041803 Jul 20 13:52:44.680314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 357/707] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:45.692104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8b7b705f-348a-4bef-91d3-f1fcd3367b00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:45.693069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8b7b705f-348a-4bef-91d3-f1fcd3367b00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:45.699572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b7b705f-348a-4bef-91d3-f1fcd3367b00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:45.700017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b7b705f-348a-4bef-91d3-f1fcd3367b00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:45.701161 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b7b705f-348a-4bef-91d3-f1fcd3367b00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:45.702266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b7b705f-348a-4bef-91d3-f1fcd3367b00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:45.730971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8b7b705f-348a-4bef-91d3-f1fcd3367b00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042893 Jul 20 13:52:45.731516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 351/708] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:46.742997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-59626568-7194-40c8-b48c-12906d3f3ee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:46.743912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-59626568-7194-40c8-b48c-12906d3f3ee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:46.750492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59626568-7194-40c8-b48c-12906d3f3ee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:46.750979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59626568-7194-40c8-b48c-12906d3f3ee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:46.751747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59626568-7194-40c8-b48c-12906d3f3ee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:46.752184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59626568-7194-40c8-b48c-12906d3f3ee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:46.781633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-59626568-7194-40c8-b48c-12906d3f3ee7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042761 Jul 20 13:52:46.782190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 358/709] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:47.793633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-869afe25-92cb-4067-b95f-3e1a3399fd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:47.794538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-869afe25-92cb-4067-b95f-3e1a3399fd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:47.801033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-869afe25-92cb-4067-b95f-3e1a3399fd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:47.801482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-869afe25-92cb-4067-b95f-3e1a3399fd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:47.802240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-869afe25-92cb-4067-b95f-3e1a3399fd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:47.802669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-869afe25-92cb-4067-b95f-3e1a3399fd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:47.831231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-869afe25-92cb-4067-b95f-3e1a3399fd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041808 Jul 20 13:52:47.831775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 352/710] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:48.843629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8eb0142b-f9e2-4e0f-8a0d-9f2dad528c9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:48.844567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8eb0142b-f9e2-4e0f-8a0d-9f2dad528c9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:48.851098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8eb0142b-f9e2-4e0f-8a0d-9f2dad528c9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:48.851548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8eb0142b-f9e2-4e0f-8a0d-9f2dad528c9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:48.852344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8eb0142b-f9e2-4e0f-8a0d-9f2dad528c9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:48.852781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8eb0142b-f9e2-4e0f-8a0d-9f2dad528c9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:48.855088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=90 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:48.882274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8eb0142b-f9e2-4e0f-8a0d-9f2dad528c9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043373 Jul 20 13:52:48.882824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 359/711] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:49.894646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-af5ed17e-a280-48e0-80ff-cf4c25901254 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:49.895562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-af5ed17e-a280-48e0-80ff-cf4c25901254 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:49.901949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af5ed17e-a280-48e0-80ff-cf4c25901254 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:49.902403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af5ed17e-a280-48e0-80ff-cf4c25901254 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:49.903170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af5ed17e-a280-48e0-80ff-cf4c25901254 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:49.903612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af5ed17e-a280-48e0-80ff-cf4c25901254 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:49.932241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-af5ed17e-a280-48e0-80ff-cf4c25901254 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041668 Jul 20 13:52:49.932789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 353/712] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:50.943066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-682c7f6d-5589-4657-b010-09f7b637bf73 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:50.944040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-682c7f6d-5589-4657-b010-09f7b637bf73 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:50.950790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-682c7f6d-5589-4657-b010-09f7b637bf73 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:50.951271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-682c7f6d-5589-4657-b010-09f7b637bf73 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:50.952034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-682c7f6d-5589-4657-b010-09f7b637bf73 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:50.952494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-682c7f6d-5589-4657-b010-09f7b637bf73 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:50.980947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-682c7f6d-5589-4657-b010-09f7b637bf73 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041902 Jul 20 13:52:50.981490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 360/713] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:51.993225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4109e93c-867d-4fc5-b017-4352de5aa91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:51.994166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4109e93c-867d-4fc5-b017-4352de5aa91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:52.000646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4109e93c-867d-4fc5-b017-4352de5aa91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:52.001035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4109e93c-867d-4fc5-b017-4352de5aa91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:52.001800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4109e93c-867d-4fc5-b017-4352de5aa91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:52.002236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4109e93c-867d-4fc5-b017-4352de5aa91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:52.031727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4109e93c-867d-4fc5-b017-4352de5aa91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042462 Jul 20 13:52:52.032311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 354/714] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:53.048810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ecbbc29e-8b57-4417-baa2-959052b33e44 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:53.049719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ecbbc29e-8b57-4417-baa2-959052b33e44 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:53.056067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ecbbc29e-8b57-4417-baa2-959052b33e44 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:53.056548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ecbbc29e-8b57-4417-baa2-959052b33e44 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:53.057300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ecbbc29e-8b57-4417-baa2-959052b33e44 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:53.057731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ecbbc29e-8b57-4417-baa2-959052b33e44 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:53.086135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ecbbc29e-8b57-4417-baa2-959052b33e44 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041421 Jul 20 13:52:53.086672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 361/715] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:54.097420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a7179906-0d36-415a-965d-d95dd3cf259d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:54.098353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a7179906-0d36-415a-965d-d95dd3cf259d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:54.104794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7179906-0d36-415a-965d-d95dd3cf259d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:54.105233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7179906-0d36-415a-965d-d95dd3cf259d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:54.105984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7179906-0d36-415a-965d-d95dd3cf259d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:54.106409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7179906-0d36-415a-965d-d95dd3cf259d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:54.135560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a7179906-0d36-415a-965d-d95dd3cf259d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042052 Jul 20 13:52:54.136104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 355/716] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:55.147274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9b341213-ed8a-4b17-8ac8-11fb6ef2d685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:55.148202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9b341213-ed8a-4b17-8ac8-11fb6ef2d685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:55.154812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b341213-ed8a-4b17-8ac8-11fb6ef2d685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:55.155257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b341213-ed8a-4b17-8ac8-11fb6ef2d685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:55.156012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b341213-ed8a-4b17-8ac8-11fb6ef2d685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:55.156479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b341213-ed8a-4b17-8ac8-11fb6ef2d685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:55.184669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9b341213-ed8a-4b17-8ac8-11fb6ef2d685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041372 Jul 20 13:52:55.185854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 362/717] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:56.196047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-22fda99b-d049-4019-ae17-3bfcddb8d62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:56.196974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-22fda99b-d049-4019-ae17-3bfcddb8d62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:56.203619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22fda99b-d049-4019-ae17-3bfcddb8d62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:56.204057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22fda99b-d049-4019-ae17-3bfcddb8d62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:56.204838 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22fda99b-d049-4019-ae17-3bfcddb8d62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:56.205265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22fda99b-d049-4019-ae17-3bfcddb8d62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:56.233936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-22fda99b-d049-4019-ae17-3bfcddb8d62a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041863 Jul 20 13:52:56.234479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 356/718] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:57.245881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1bb0e16a-99d9-4a5b-844b-ad15c00c3156 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:57.246802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1bb0e16a-99d9-4a5b-844b-ad15c00c3156 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:57.253752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1bb0e16a-99d9-4a5b-844b-ad15c00c3156 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:57.254206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1bb0e16a-99d9-4a5b-844b-ad15c00c3156 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:57.254974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1bb0e16a-99d9-4a5b-844b-ad15c00c3156 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:57.255408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1bb0e16a-99d9-4a5b-844b-ad15c00c3156 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:57.283866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1bb0e16a-99d9-4a5b-844b-ad15c00c3156 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041961 Jul 20 13:52:57.284446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 363/719] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:58.296159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-20e4fc55-6752-4c83-bfdd-2e5e35eabea7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:58.297646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-20e4fc55-6752-4c83-bfdd-2e5e35eabea7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:58.304061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20e4fc55-6752-4c83-bfdd-2e5e35eabea7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:58.304534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20e4fc55-6752-4c83-bfdd-2e5e35eabea7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:58.305294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20e4fc55-6752-4c83-bfdd-2e5e35eabea7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:58.305720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20e4fc55-6752-4c83-bfdd-2e5e35eabea7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:58.335568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-20e4fc55-6752-4c83-bfdd-2e5e35eabea7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043869 Jul 20 13:52:58.336116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 357/720] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:52:59.347053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-146f49fa-bbb9-451e-b63f-a5cf9c5c4adc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:52:59.347947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-146f49fa-bbb9-451e-b63f-a5cf9c5c4adc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:52:59.354065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-146f49fa-bbb9-451e-b63f-a5cf9c5c4adc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:59.354510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-146f49fa-bbb9-451e-b63f-a5cf9c5c4adc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:59.355256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-146f49fa-bbb9-451e-b63f-a5cf9c5c4adc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:52:59.355692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-146f49fa-bbb9-451e-b63f-a5cf9c5c4adc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:52:59.384552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-146f49fa-bbb9-451e-b63f-a5cf9c5c4adc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041481 Jul 20 13:52:59.385096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 364/721] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:52:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:00.396906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-454e2960-0ac3-4886-9df6-1cd5a30bfef7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:00.397810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-454e2960-0ac3-4886-9df6-1cd5a30bfef7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:00.404753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-454e2960-0ac3-4886-9df6-1cd5a30bfef7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:00.405196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-454e2960-0ac3-4886-9df6-1cd5a30bfef7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:00.405949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-454e2960-0ac3-4886-9df6-1cd5a30bfef7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:00.406374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-454e2960-0ac3-4886-9df6-1cd5a30bfef7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:00.433966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-454e2960-0ac3-4886-9df6-1cd5a30bfef7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041020 Jul 20 13:53:00.434611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 358/722] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:01.446077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1470b388-b501-4bfe-ae5c-5ad923920c4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:01.446996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1470b388-b501-4bfe-ae5c-5ad923920c4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:01.454254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1470b388-b501-4bfe-ae5c-5ad923920c4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:01.454704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1470b388-b501-4bfe-ae5c-5ad923920c4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:01.455471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1470b388-b501-4bfe-ae5c-5ad923920c4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:01.455903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1470b388-b501-4bfe-ae5c-5ad923920c4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:01.486719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1470b388-b501-4bfe-ae5c-5ad923920c4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044392 Jul 20 13:53:01.487331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 365/723] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:02.498350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9ef221e8-7b99-434a-b220-1c80c6624e6d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:02.499258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9ef221e8-7b99-434a-b220-1c80c6624e6d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:02.505791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ef221e8-7b99-434a-b220-1c80c6624e6d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:02.506234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ef221e8-7b99-434a-b220-1c80c6624e6d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:02.506991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ef221e8-7b99-434a-b220-1c80c6624e6d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:02.507424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ef221e8-7b99-434a-b220-1c80c6624e6d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:02.537028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9ef221e8-7b99-434a-b220-1c80c6624e6d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042937 Jul 20 13:53:02.537585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 359/724] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:03.549178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bbea3e37-f313-49de-8b75-30d7ab8a235f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:03.550087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bbea3e37-f313-49de-8b75-30d7ab8a235f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:03.556445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bbea3e37-f313-49de-8b75-30d7ab8a235f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:03.556889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bbea3e37-f313-49de-8b75-30d7ab8a235f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:03.557668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bbea3e37-f313-49de-8b75-30d7ab8a235f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:03.558093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bbea3e37-f313-49de-8b75-30d7ab8a235f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:03.588624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bbea3e37-f313-49de-8b75-30d7ab8a235f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043305 Jul 20 13:53:03.589192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 366/725] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:03.862910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:53:03.863418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:03.869736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:03.870178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:03.870926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:03.871353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:03.892714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lazy-loading 'flavor' on Instance uuid 36f9c037-a55c-46c4-aae3-4929db5f0193 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:53:03.963772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-00391f7a-c23e-4d9c-bb61-f8aff93fd7f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "POST /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193/action" status: 202 len: 0 microversion: 2.1 time: 0.104578 Jul 20 13:53:03.964453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 360/726] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 13:53:03 2022] POST /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:53:03.973125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:03.973739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:03.979879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:03.980428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:03.981225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:03.982288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:04.168268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:04.175836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0418e919-79ea-4a98-bf55-086d863f776c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.206524 Jul 20 13:53:04.176420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 367/727] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:04.601573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f34cc16-d168-4bdc-aefc-f808cf73dc1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:04.602577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f34cc16-d168-4bdc-aefc-f808cf73dc1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:04.609518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f34cc16-d168-4bdc-aefc-f808cf73dc1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:04.609963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f34cc16-d168-4bdc-aefc-f808cf73dc1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:04.610725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f34cc16-d168-4bdc-aefc-f808cf73dc1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:04.611183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f34cc16-d168-4bdc-aefc-f808cf73dc1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:04.635518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:04.640782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f34cc16-d168-4bdc-aefc-f808cf73dc1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043597 Jul 20 13:53:04.641343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 361/728] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:05.194218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:05.194782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:05.202209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:05.202675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:05.203425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:05.203851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:05.333650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:05.341085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2c1daf57-19be-4c0a-bc80-b5c4e899f2f4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150672 Jul 20 13:53:05.341648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 368/729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:05.652687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cc8d4003-c0f8-4c4e-ac01-e32b71fda2e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:05.654227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cc8d4003-c0f8-4c4e-ac01-e32b71fda2e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:05.662025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc8d4003-c0f8-4c4e-ac01-e32b71fda2e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:05.662471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc8d4003-c0f8-4c4e-ac01-e32b71fda2e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:05.663236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc8d4003-c0f8-4c4e-ac01-e32b71fda2e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:05.663666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc8d4003-c0f8-4c4e-ac01-e32b71fda2e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:05.691927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cc8d4003-c0f8-4c4e-ac01-e32b71fda2e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043306 Jul 20 13:53:05.692517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 362/730] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:06.358770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:06.359366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:06.365703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:06.366151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:06.366909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:06.367345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:06.498502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:06.505895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bf40002f-6ec1-4aca-a833-2f02cf1aa05c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151551 Jul 20 13:53:06.506458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 369/731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:06.704294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f547c350-1914-49c2-b5d5-6499cf9b7c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:06.705530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f547c350-1914-49c2-b5d5-6499cf9b7c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:06.712248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f547c350-1914-49c2-b5d5-6499cf9b7c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:06.712770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f547c350-1914-49c2-b5d5-6499cf9b7c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:06.713607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f547c350-1914-49c2-b5d5-6499cf9b7c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:06.714047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f547c350-1914-49c2-b5d5-6499cf9b7c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:06.742795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f547c350-1914-49c2-b5d5-6499cf9b7c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043609 Jul 20 13:53:06.743349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 363/732] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:07.523696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:07.524248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:07.531213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:07.531651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:07.532442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:07.532882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:07.668509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:07.676609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2a11099c-b20a-4ce6-8d4a-69dd9e264d58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.156822 Jul 20 13:53:07.677174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 370/733] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:07.754111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4c5c00c-d8f9-4e9a-96fd-8b80e9920f89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:07.755029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f4c5c00c-d8f9-4e9a-96fd-8b80e9920f89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:07.757301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=34 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:07.762553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4c5c00c-d8f9-4e9a-96fd-8b80e9920f89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:07.763511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4c5c00c-d8f9-4e9a-96fd-8b80e9920f89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:07.764309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4c5c00c-d8f9-4e9a-96fd-8b80e9920f89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:07.764746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4c5c00c-d8f9-4e9a-96fd-8b80e9920f89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:07.794620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f4c5c00c-d8f9-4e9a-96fd-8b80e9920f89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Jul 20 13:53:07.795093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 364/734] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:08.693524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:08.694124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:08.701084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:08.701532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:08.702281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:08.702709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:08.806289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2921eeae-667b-4c0a-b021-dbfc346c3d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:08.807336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2921eeae-667b-4c0a-b021-dbfc346c3d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:08.813857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2921eeae-667b-4c0a-b021-dbfc346c3d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:08.814387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2921eeae-667b-4c0a-b021-dbfc346c3d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:08.815162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2921eeae-667b-4c0a-b021-dbfc346c3d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:08.815599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2921eeae-667b-4c0a-b021-dbfc346c3d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:08.830231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:08.837583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0af4cec0-f391-4d26-8b6d-6ba80c9e6e8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147946 Jul 20 13:53:08.838147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 371/735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:08.845404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2921eeae-667b-4c0a-b021-dbfc346c3d68 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043142 Jul 20 13:53:08.845960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 365/736] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:09.854694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:09.855286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:09.857494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4cc20207-f86c-4f8c-9569-574c15248648 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:09.858409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4cc20207-f86c-4f8c-9569-574c15248648 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:09.862623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:09.863071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:09.863843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:09.864312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:09.864751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc20207-f86c-4f8c-9569-574c15248648 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:09.865203 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc20207-f86c-4f8c-9569-574c15248648 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:09.865968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc20207-f86c-4f8c-9569-574c15248648 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:09.866405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc20207-f86c-4f8c-9569-574c15248648 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:09.894494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4cc20207-f86c-4f8c-9569-574c15248648 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041535 Jul 20 13:53:09.895054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 366/737] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:09.998458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:10.006118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0d8986a2-3d56-4b61-825d-8ef15d09fde0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155275 Jul 20 13:53:10.006706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 372/738] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:10.906206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-09a3b604-cede-4850-a1d3-541d9ed5dd8e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:10.907122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-09a3b604-cede-4850-a1d3-541d9ed5dd8e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:10.913528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09a3b604-cede-4850-a1d3-541d9ed5dd8e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:10.913977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09a3b604-cede-4850-a1d3-541d9ed5dd8e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:10.914738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09a3b604-cede-4850-a1d3-541d9ed5dd8e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:10.915168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-09a3b604-cede-4850-a1d3-541d9ed5dd8e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:10.943992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-09a3b604-cede-4850-a1d3-541d9ed5dd8e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041779 Jul 20 13:53:10.944592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 367/739] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:11.023620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:11.024251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:11.026495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=36 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:11.031919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:11.032404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:11.033167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:11.033602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:11.167830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:11.175849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f2e20c43-646d-40cc-8d36-30e29ce8f73c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.156042 Jul 20 13:53:11.176442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 373/740] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:11.955886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-129458d5-14a3-41c6-aae3-27ad0523e13a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:11.956859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-129458d5-14a3-41c6-aae3-27ad0523e13a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:11.963517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-129458d5-14a3-41c6-aae3-27ad0523e13a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:11.963963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-129458d5-14a3-41c6-aae3-27ad0523e13a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:11.964765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-129458d5-14a3-41c6-aae3-27ad0523e13a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:11.965251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-129458d5-14a3-41c6-aae3-27ad0523e13a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:11.995276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-129458d5-14a3-41c6-aae3-27ad0523e13a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043430 Jul 20 13:53:11.995822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 368/741] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:12.192706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:12.193315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:12.199807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:12.200538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:12.201305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:12.201740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:12.332160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:12.339599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-16cd7c07-4b8b-4227-8a4c-67ce0a9fcb70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150690 Jul 20 13:53:12.340167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 374/742] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:13.007214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe3f20b7-0687-47de-965a-d3cbd2bb25f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:13.008125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe3f20b7-0687-47de-965a-d3cbd2bb25f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:13.014966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe3f20b7-0687-47de-965a-d3cbd2bb25f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:13.015413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe3f20b7-0687-47de-965a-d3cbd2bb25f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:13.016174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe3f20b7-0687-47de-965a-d3cbd2bb25f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:13.016640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe3f20b7-0687-47de-965a-d3cbd2bb25f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:13.046422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe3f20b7-0687-47de-965a-d3cbd2bb25f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043194 Jul 20 13:53:13.047210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 369/743] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:13.357733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:13.358344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:13.364825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:13.365269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:13.366037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:13.366473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:13.514575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:13.516790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:13.523637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7d6db7f7-5b6c-4b5c-bb8d-1ba8024425b2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.169695 Jul 20 13:53:13.524244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 375/744] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:14.058787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-755d3b2c-8873-491a-a206-b8ba48b48b9a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:14.061633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-755d3b2c-8873-491a-a206-b8ba48b48b9a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:14.068057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-755d3b2c-8873-491a-a206-b8ba48b48b9a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:14.068533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-755d3b2c-8873-491a-a206-b8ba48b48b9a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:14.069285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-755d3b2c-8873-491a-a206-b8ba48b48b9a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:14.069712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-755d3b2c-8873-491a-a206-b8ba48b48b9a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:14.098773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-755d3b2c-8873-491a-a206-b8ba48b48b9a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043733 Jul 20 13:53:14.098773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 370/745] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:14.541872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:14.542563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:14.549164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:14.549622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:14.550389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:14.550831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:14.757425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:14.765289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0f88c3be-7406-4ae7-8080-ee0fe3a723ef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.227860 Jul 20 13:53:14.765856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 376/746] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:15.109751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8ac76f29-8036-4bc1-91db-72ec62c78212 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:15.110655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8ac76f29-8036-4bc1-91db-72ec62c78212 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:15.117064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac76f29-8036-4bc1-91db-72ec62c78212 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:15.117487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac76f29-8036-4bc1-91db-72ec62c78212 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:15.118239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac76f29-8036-4bc1-91db-72ec62c78212 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:15.118676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac76f29-8036-4bc1-91db-72ec62c78212 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:15.147266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8ac76f29-8036-4bc1-91db-72ec62c78212 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041476 Jul 20 13:53:15.147808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 371/747] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:15.782118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:15.782716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:15.789189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:15.789634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:15.790381 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:15.790808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:15.917368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:15.925789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5a81afed-73d6-4d52-8ec2-bb2658ce4bf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147523 Jul 20 13:53:15.926379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 377/748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:16.158903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a4ef968e-9f89-4f31-b258-fa0c67107621 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:16.159832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a4ef968e-9f89-4f31-b258-fa0c67107621 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:16.166265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ef968e-9f89-4f31-b258-fa0c67107621 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:16.166651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ef968e-9f89-4f31-b258-fa0c67107621 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:16.167412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ef968e-9f89-4f31-b258-fa0c67107621 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:16.167843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ef968e-9f89-4f31-b258-fa0c67107621 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:16.196585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a4ef968e-9f89-4f31-b258-fa0c67107621 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041691 Jul 20 13:53:16.197124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 372/749] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:16.942355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:16.942963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:16.949396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:16.949839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:16.950863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:16.951295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:17.083745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:17.091103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46e8da09-9df9-40f6-9ab9-6e77a446ed38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152664 Jul 20 13:53:17.091652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 378/750] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:17.208646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-37ee6ff7-01dc-4482-9af9-523d9fbc1121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:17.209477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-37ee6ff7-01dc-4482-9af9-523d9fbc1121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:17.216011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ee6ff7-01dc-4482-9af9-523d9fbc1121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:17.216492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ee6ff7-01dc-4482-9af9-523d9fbc1121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:17.217254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ee6ff7-01dc-4482-9af9-523d9fbc1121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:17.217686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ee6ff7-01dc-4482-9af9-523d9fbc1121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:17.245916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-37ee6ff7-01dc-4482-9af9-523d9fbc1121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041564 Jul 20 13:53:17.246456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 373/751] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:18.108007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:18.108668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:18.115015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:18.115451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:18.116213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:18.116652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:18.243823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:18.251722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-42303014-a445-4ecb-b3a8-8779644726ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147625 Jul 20 13:53:18.252461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 379/752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:18.257561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eea200eb-8464-4ead-8ba0-73a6315c2cac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:18.258472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eea200eb-8464-4ead-8ba0-73a6315c2cac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:18.265381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eea200eb-8464-4ead-8ba0-73a6315c2cac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:18.265830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eea200eb-8464-4ead-8ba0-73a6315c2cac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:18.266591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eea200eb-8464-4ead-8ba0-73a6315c2cac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:18.267020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eea200eb-8464-4ead-8ba0-73a6315c2cac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:18.296809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eea200eb-8464-4ead-8ba0-73a6315c2cac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043238 Jul 20 13:53:18.297360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 374/753] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:19.269741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:19.270339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:19.276660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:19.277100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:19.277893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:19.278327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:19.308010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9acbcec2-b3b4-437f-a8e5-fdd3e76344f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:19.308947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9acbcec2-b3b4-437f-a8e5-fdd3e76344f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:19.315966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9acbcec2-b3b4-437f-a8e5-fdd3e76344f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:19.316448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9acbcec2-b3b4-437f-a8e5-fdd3e76344f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:19.317220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9acbcec2-b3b4-437f-a8e5-fdd3e76344f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:19.317654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9acbcec2-b3b4-437f-a8e5-fdd3e76344f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:19.348948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9acbcec2-b3b4-437f-a8e5-fdd3e76344f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Jul 20 13:53:19.349722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 375/754] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:19.411851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:19.419916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c32e9cd1-c69b-4b1d-81a3-cc375babb359 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154057 Jul 20 13:53:19.420513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 380/755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:19.503804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-2b5614ae-f83f-4cd5-8ea1-4c3ea76164b0 req-300dbe16-953e-4cb3-b7c8-a38560989643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f9c037-a55c-46c4-aae3-4929db5f0193", "name": "network-vif-unplugged", "status": "completed", "tag": "f1fd1db3-83b1-4e8d-a486-5ac886455b89"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:53:19.512078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-2b5614ae-f83f-4cd5-8ea1-4c3ea76164b0 req-300dbe16-953e-4cb3-b7c8-a38560989643 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:19.512557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-2b5614ae-f83f-4cd5-8ea1-4c3ea76164b0 req-300dbe16-953e-4cb3-b7c8-a38560989643 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:19.524031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-2b5614ae-f83f-4cd5-8ea1-4c3ea76164b0 req-300dbe16-953e-4cb3-b7c8-a38560989643 service nova] Creating event network-vif-unplugged:f1fd1db3-83b1-4e8d-a486-5ac886455b89 for instance 36f9c037-a55c-46c4-aae3-4929db5f0193 on hv-cinder-81914 Jul 20 13:53:19.529572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-2b5614ae-f83f-4cd5-8ea1-4c3ea76164b0 req-300dbe16-953e-4cb3-b7c8-a38560989643 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086931 Jul 20 13:53:19.530192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 376/756] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:53:20.360936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-507a3912-d4c7-46b3-878e-e3fa57d1a20c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:20.361778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-507a3912-d4c7-46b3-878e-e3fa57d1a20c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:20.368247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507a3912-d4c7-46b3-878e-e3fa57d1a20c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:20.368701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507a3912-d4c7-46b3-878e-e3fa57d1a20c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:20.369473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507a3912-d4c7-46b3-878e-e3fa57d1a20c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:20.369911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507a3912-d4c7-46b3-878e-e3fa57d1a20c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:20.399342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-507a3912-d4c7-46b3-878e-e3fa57d1a20c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042533 Jul 20 13:53:20.399893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 381/757] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:20.438797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:20.439548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:20.446207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:20.446694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:20.447459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:20.447897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:20.634559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:20.642172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d3eef2b8-fb0a-4760-b2d1-3061fb680401 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.209119 Jul 20 13:53:20.642741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 377/758] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:21.410115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cc528f17-e6bd-4af0-bc2d-dcb6e4c89685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:21.411032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cc528f17-e6bd-4af0-bc2d-dcb6e4c89685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:21.417463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc528f17-e6bd-4af0-bc2d-dcb6e4c89685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:21.417912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc528f17-e6bd-4af0-bc2d-dcb6e4c89685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:21.418697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc528f17-e6bd-4af0-bc2d-dcb6e4c89685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:21.419129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc528f17-e6bd-4af0-bc2d-dcb6e4c89685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:21.448457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cc528f17-e6bd-4af0-bc2d-dcb6e4c89685 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042332 Jul 20 13:53:21.449017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 382/759] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:21.659239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:21.659843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:21.666346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:21.666727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:21.667478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:21.667907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:21.796716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:21.804084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a1693bc5-17f8-4844-bea0-0c051dda27a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148723 Jul 20 13:53:21.804679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 378/760] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:22.461766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cb7bc68a-27d5-4255-a825-cfdf7c78b0f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:22.462675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cb7bc68a-27d5-4255-a825-cfdf7c78b0f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:22.469858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb7bc68a-27d5-4255-a825-cfdf7c78b0f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:22.470298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb7bc68a-27d5-4255-a825-cfdf7c78b0f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:22.471047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb7bc68a-27d5-4255-a825-cfdf7c78b0f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:22.471473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb7bc68a-27d5-4255-a825-cfdf7c78b0f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:22.500523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cb7bc68a-27d5-4255-a825-cfdf7c78b0f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043307 Jul 20 13:53:22.501070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 383/761] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:22.825437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:22.826088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:22.837032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:22.837736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:22.838552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:22.838997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:22.841984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:22.971877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:22.979351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-086fa9ef-ac01-4638-85a6-af4d1fdc8d72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.161557 Jul 20 13:53:22.979914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 379/762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:23.512805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9cac69b2-9858-4ff0-8fa9-a8e943790257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:23.514197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9cac69b2-9858-4ff0-8fa9-a8e943790257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:23.521049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cac69b2-9858-4ff0-8fa9-a8e943790257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:23.521614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cac69b2-9858-4ff0-8fa9-a8e943790257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:23.522393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cac69b2-9858-4ff0-8fa9-a8e943790257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:23.522833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cac69b2-9858-4ff0-8fa9-a8e943790257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:23.555194 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9cac69b2-9858-4ff0-8fa9-a8e943790257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046919 Jul 20 13:53:23.555744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 384/763] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:23.996618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:23.997245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:24.003537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:24.003979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:24.004765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:24.005192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:24.132593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:24.140085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe5effed-a91d-44c0-9052-621a07654056 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147250 Jul 20 13:53:24.140673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 380/764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:24.567073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff07e713-67b0-4c26-8d26-0d9b94a50096 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:24.568032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff07e713-67b0-4c26-8d26-0d9b94a50096 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:24.574604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff07e713-67b0-4c26-8d26-0d9b94a50096 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:24.575340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff07e713-67b0-4c26-8d26-0d9b94a50096 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:24.576135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff07e713-67b0-4c26-8d26-0d9b94a50096 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:24.576618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff07e713-67b0-4c26-8d26-0d9b94a50096 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:24.606273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff07e713-67b0-4c26-8d26-0d9b94a50096 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042719 Jul 20 13:53:24.606820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 385/765] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:25.158015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:25.158886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:25.166550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:25.166998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:25.167971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:25.169118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:25.304118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:25.312350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e0ef21ac-6091-465f-9def-73220e84b866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.158485 Jul 20 13:53:25.312946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 381/766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:25.617645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c18f7afc-d21f-48d2-b7fa-039111724239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:25.618470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c18f7afc-d21f-48d2-b7fa-039111724239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:25.625478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c18f7afc-d21f-48d2-b7fa-039111724239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:25.625922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c18f7afc-d21f-48d2-b7fa-039111724239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:25.626687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c18f7afc-d21f-48d2-b7fa-039111724239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:25.627118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c18f7afc-d21f-48d2-b7fa-039111724239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:25.656573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c18f7afc-d21f-48d2-b7fa-039111724239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042929 Jul 20 13:53:25.657127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 386/767] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:26.330522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:26.331124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:26.337533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:26.337978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:26.338729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:26.339154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:26.466052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:26.473482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b63f7a6f-c155-4bef-8f32-29dca7702352 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.146898 Jul 20 13:53:26.474039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 382/768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:26.668372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8a91a8ea-c8e1-486d-b205-78ff6a56fca1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:26.669205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8a91a8ea-c8e1-486d-b205-78ff6a56fca1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:26.675942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a91a8ea-c8e1-486d-b205-78ff6a56fca1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:26.676420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a91a8ea-c8e1-486d-b205-78ff6a56fca1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:26.677172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a91a8ea-c8e1-486d-b205-78ff6a56fca1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:26.677602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a91a8ea-c8e1-486d-b205-78ff6a56fca1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:26.706603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8a91a8ea-c8e1-486d-b205-78ff6a56fca1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042325 Jul 20 13:53:26.707145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 387/769] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:27.491300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:27.491942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:27.499215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:27.499662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:27.500457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:27.500890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:27.632381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:27.640046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b93f6dd6-a3dc-49ce-b659-f7a2d83fd39f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152902 Jul 20 13:53:27.640816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 383/770] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:27.718759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3ff8f0b6-0638-4b9f-b585-129f6d899ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:27.719658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3ff8f0b6-0638-4b9f-b585-129f6d899ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:27.726097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ff8f0b6-0638-4b9f-b585-129f6d899ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:27.726536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ff8f0b6-0638-4b9f-b585-129f6d899ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:27.727423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ff8f0b6-0638-4b9f-b585-129f6d899ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:27.727853 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ff8f0b6-0638-4b9f-b585-129f6d899ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:27.757209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3ff8f0b6-0638-4b9f-b585-129f6d899ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043010 Jul 20 13:53:27.757675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 388/771] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:28.656651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:28.657291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:28.663948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:28.664442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:28.665206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:28.665662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:28.768995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ac67fca0-4e81-4ab2-8ef1-510a620a864e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:28.770036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ac67fca0-4e81-4ab2-8ef1-510a620a864e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:28.776652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac67fca0-4e81-4ab2-8ef1-510a620a864e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:28.777102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac67fca0-4e81-4ab2-8ef1-510a620a864e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:28.778445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac67fca0-4e81-4ab2-8ef1-510a620a864e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:28.778907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac67fca0-4e81-4ab2-8ef1-510a620a864e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:28.800463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:28.807712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ac67fca0-4e81-4ab2-8ef1-510a620a864e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042616 Jul 20 13:53:28.807893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f482b62-df24-41e4-a0ea-374c691a509f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155356 Jul 20 13:53:28.808310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 389/772] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:28.808435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 384/773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:29.819632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ce85dfcb-b9af-4631-acd4-90dae035b83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:29.820495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ce85dfcb-b9af-4631-acd4-90dae035b83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:29.826674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:29.826674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:29.827288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce85dfcb-b9af-4631-acd4-90dae035b83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:29.827737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce85dfcb-b9af-4631-acd4-90dae035b83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:29.828547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce85dfcb-b9af-4631-acd4-90dae035b83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:29.828985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce85dfcb-b9af-4631-acd4-90dae035b83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:29.833161 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:29.833613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:29.834425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:29.834862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:29.858115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ce85dfcb-b9af-4631-acd4-90dae035b83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042508 Jul 20 13:53:29.858671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 390/774] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:29.965440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:29.973086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8c817e71-5b11-4fd1-be46-af337868468f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152463 Jul 20 13:53:29.973645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 385/775] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:53:30.869809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-53e21744-1609-4aa3-b332-e417952cc039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:30.870720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-53e21744-1609-4aa3-b332-e417952cc039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:30.877172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53e21744-1609-4aa3-b332-e417952cc039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:30.877616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53e21744-1609-4aa3-b332-e417952cc039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:30.878375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53e21744-1609-4aa3-b332-e417952cc039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:30.878806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53e21744-1609-4aa3-b332-e417952cc039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:30.907839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-53e21744-1609-4aa3-b332-e417952cc039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041994 Jul 20 13:53:30.908415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 391/776] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:30.991212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:30.991816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:30.998399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:30.998917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:30.999678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:31.000111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:31.130229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:31.138618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-73b93d4b-2b3d-42c0-ae4b-a1d7438be969 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151206 Jul 20 13:53:31.139214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 386/777] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:31.919562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-07ff48a5-d91d-400f-a9e6-b59e56c3296a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:31.920490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-07ff48a5-d91d-400f-a9e6-b59e56c3296a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:31.926792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07ff48a5-d91d-400f-a9e6-b59e56c3296a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:31.927227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07ff48a5-d91d-400f-a9e6-b59e56c3296a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:31.928008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07ff48a5-d91d-400f-a9e6-b59e56c3296a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:31.928461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07ff48a5-d91d-400f-a9e6-b59e56c3296a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:31.941697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:31.957949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-07ff48a5-d91d-400f-a9e6-b59e56c3296a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042389 Jul 20 13:53:31.958488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 392/778] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:32.155414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:32.156022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:32.162443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:32.162892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:32.163660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:32.164095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:32.293045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:32.300519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a2d88681-e3a3-4f49-9edb-a09eefcaa83c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148907 Jul 20 13:53:32.301090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 387/779] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:32.970092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5f1d9ebd-d5fb-4bce-9c87-ce5823e01bec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:32.971007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5f1d9ebd-d5fb-4bce-9c87-ce5823e01bec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:32.977405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f1d9ebd-d5fb-4bce-9c87-ce5823e01bec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:32.977847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f1d9ebd-d5fb-4bce-9c87-ce5823e01bec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:32.978593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f1d9ebd-d5fb-4bce-9c87-ce5823e01bec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:32.979020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f1d9ebd-d5fb-4bce-9c87-ce5823e01bec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:33.007794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5f1d9ebd-d5fb-4bce-9c87-ce5823e01bec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041701 Jul 20 13:53:33.008357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 393/780] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:33.318006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:33.318527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:33.325243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:33.325680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:33.326428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:33.326858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:33.459255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:33.467627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c5c14932-360e-4673-a1e7-b02c7de06cb1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153486 Jul 20 13:53:33.468175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 388/781] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:34.019714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-03e360a6-21e2-45e0-a8a8-4c52633b4ff1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:34.020655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-03e360a6-21e2-45e0-a8a8-4c52633b4ff1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:34.027825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03e360a6-21e2-45e0-a8a8-4c52633b4ff1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:34.028303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03e360a6-21e2-45e0-a8a8-4c52633b4ff1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:34.029073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03e360a6-21e2-45e0-a8a8-4c52633b4ff1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:34.029505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03e360a6-21e2-45e0-a8a8-4c52633b4ff1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:34.057287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-03e360a6-21e2-45e0-a8a8-4c52633b4ff1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041591 Jul 20 13:53:34.057821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 394/782] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:34.485286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:34.485891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:34.492285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:34.492722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:34.493475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:34.493900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:34.625544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:34.636911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6c61e711-dc65-460d-b229-f481fbffa587 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154582 Jul 20 13:53:34.637240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 389/783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:35.068367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cfb32e9f-dea0-46a7-aae4-d33debc0a229 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:35.069306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cfb32e9f-dea0-46a7-aae4-d33debc0a229 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:35.076023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfb32e9f-dea0-46a7-aae4-d33debc0a229 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:35.076546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfb32e9f-dea0-46a7-aae4-d33debc0a229 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:35.077270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfb32e9f-dea0-46a7-aae4-d33debc0a229 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:35.077701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfb32e9f-dea0-46a7-aae4-d33debc0a229 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:35.106024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cfb32e9f-dea0-46a7-aae4-d33debc0a229 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041277 Jul 20 13:53:35.106573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 395/784] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:35.660108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:35.660748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:35.667189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:35.668140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:35.669008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:35.669443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:35.797327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:35.804746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f447ced8-fffb-46f9-978e-8b8a5320ff2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149503 Jul 20 13:53:35.805303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 390/785] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:36.117338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2beca6ee-e6ee-4845-9063-8775151a4a0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:36.118250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2beca6ee-e6ee-4845-9063-8775151a4a0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:36.125251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2beca6ee-e6ee-4845-9063-8775151a4a0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:36.125692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2beca6ee-e6ee-4845-9063-8775151a4a0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:36.126447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2beca6ee-e6ee-4845-9063-8775151a4a0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:36.126879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2beca6ee-e6ee-4845-9063-8775151a4a0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:36.155726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2beca6ee-e6ee-4845-9063-8775151a4a0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042372 Jul 20 13:53:36.156298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 396/786] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:36.822203 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:36.822809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:36.830151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:36.830602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:36.831355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:36.831800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:36.965459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:36.973008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5884b7d0-9cc2-427d-ad10-8a4845f76c8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154672 Jul 20 13:53:36.973610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 391/787] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:37.167474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e0262242-bd72-492e-ada0-6141a206f602 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:37.168458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e0262242-bd72-492e-ada0-6141a206f602 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:37.175034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0262242-bd72-492e-ada0-6141a206f602 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:37.175482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0262242-bd72-492e-ada0-6141a206f602 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:37.176265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0262242-bd72-492e-ada0-6141a206f602 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:37.176704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0262242-bd72-492e-ada0-6141a206f602 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:37.205074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e0262242-bd72-492e-ada0-6141a206f602 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041695 Jul 20 13:53:37.205610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 397/788] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:37.990611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:37.991221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:37.993632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=56 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:37.999675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:38.000128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:38.000967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:38.001404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:38.131294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:38.138921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1d2c3a52-be1b-4047-9215-d4c163bddbfa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152159 Jul 20 13:53:38.139487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 392/789] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:38.217215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-040fa539-f3a9-41cf-8692-af48e869f0a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:38.218136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-040fa539-f3a9-41cf-8692-af48e869f0a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:38.224509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-040fa539-f3a9-41cf-8692-af48e869f0a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:38.224966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-040fa539-f3a9-41cf-8692-af48e869f0a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:38.225729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-040fa539-f3a9-41cf-8692-af48e869f0a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:38.226169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-040fa539-f3a9-41cf-8692-af48e869f0a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:38.254700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-040fa539-f3a9-41cf-8692-af48e869f0a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041970 Jul 20 13:53:38.255181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 398/790] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:39.155833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:39.156469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:39.162910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:39.163352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:39.164116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:39.164578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:39.266484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0920bb7b-3a08-4db3-aa0f-33ddbad60bcb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:39.267567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0920bb7b-3a08-4db3-aa0f-33ddbad60bcb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:39.274118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920bb7b-3a08-4db3-aa0f-33ddbad60bcb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:39.274571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920bb7b-3a08-4db3-aa0f-33ddbad60bcb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:39.275375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920bb7b-3a08-4db3-aa0f-33ddbad60bcb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:39.275811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920bb7b-3a08-4db3-aa0f-33ddbad60bcb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:39.299631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:39.306003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0920bb7b-3a08-4db3-aa0f-33ddbad60bcb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044593 Jul 20 13:53:39.306573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 399/791] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:39.307260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-16e06e7f-57c4-4b39-bee1-b02cb8bbda8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155263 Jul 20 13:53:39.307831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 393/792] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:40.318632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-31219c9c-f6cf-41f0-b5e9-810d6cd6565d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:40.319493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-31219c9c-f6cf-41f0-b5e9-810d6cd6565d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:40.325198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:40.325864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:40.326148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-31219c9c-f6cf-41f0-b5e9-810d6cd6565d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:40.326595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-31219c9c-f6cf-41f0-b5e9-810d6cd6565d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:40.327354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-31219c9c-f6cf-41f0-b5e9-810d6cd6565d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:40.327779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-31219c9c-f6cf-41f0-b5e9-810d6cd6565d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:40.332445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:40.332897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:40.333669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:40.334104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:40.356415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-31219c9c-f6cf-41f0-b5e9-810d6cd6565d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041763 Jul 20 13:53:40.356972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 400/793] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:40.466364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:40.474368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1038ac2e-0bd0-4916-ac4c-e07b4b90d0d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153575 Jul 20 13:53:40.474997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 394/794] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:41.367580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5aa6394d-9370-40da-ad7a-b6df43060c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:41.368540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5aa6394d-9370-40da-ad7a-b6df43060c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:41.371303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=56 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:41.377216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aa6394d-9370-40da-ad7a-b6df43060c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:41.377670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aa6394d-9370-40da-ad7a-b6df43060c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:41.378457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aa6394d-9370-40da-ad7a-b6df43060c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:41.378894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aa6394d-9370-40da-ad7a-b6df43060c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:41.408336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5aa6394d-9370-40da-ad7a-b6df43060c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Jul 20 13:53:41.408904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 401/795] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:41.491721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:41.492362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:41.498898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:41.499338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:41.500106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:41.500569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:41.630842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:41.633096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:41.640259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-294be8c3-c3bd-4049-83ea-1e636e52d859 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152411 Jul 20 13:53:41.640956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 395/796] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:42.419472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-66c723c9-eb5a-4358-a937-f88b8aee9b95 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:42.420413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-66c723c9-eb5a-4358-a937-f88b8aee9b95 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:42.426817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66c723c9-eb5a-4358-a937-f88b8aee9b95 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:42.427254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66c723c9-eb5a-4358-a937-f88b8aee9b95 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:42.428006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66c723c9-eb5a-4358-a937-f88b8aee9b95 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:42.428457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66c723c9-eb5a-4358-a937-f88b8aee9b95 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:42.460737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-66c723c9-eb5a-4358-a937-f88b8aee9b95 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045464 Jul 20 13:53:42.461730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 402/797] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:42.657581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:42.658240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:42.664786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:42.665228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:42.665979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:42.666402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:42.793828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:42.801164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4484c36f-1278-42f2-a699-d2049c08a638 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147485 Jul 20 13:53:42.801739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 396/798] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:43.472724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ca779851-fe90-4936-b67f-1734da2b4c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:43.473791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ca779851-fe90-4936-b67f-1734da2b4c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:43.480823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca779851-fe90-4936-b67f-1734da2b4c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:43.481272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca779851-fe90-4936-b67f-1734da2b4c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:43.482036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca779851-fe90-4936-b67f-1734da2b4c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:43.482570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca779851-fe90-4936-b67f-1734da2b4c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:43.511218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ca779851-fe90-4936-b67f-1734da2b4c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042468 Jul 20 13:53:43.511812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 403/799] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:43.819128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:43.819673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:43.826802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:43.827249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:43.828009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:43.828612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:43.957519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:43.964927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ec60a66a-e995-45e0-bdfd-3d0746ac7ed2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149756 Jul 20 13:53:43.965496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 397/800] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:44.522975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-932fd42b-9c45-4515-8947-ea0b8a96a3eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:44.523888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-932fd42b-9c45-4515-8947-ea0b8a96a3eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:44.531057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-932fd42b-9c45-4515-8947-ea0b8a96a3eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:44.531501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-932fd42b-9c45-4515-8947-ea0b8a96a3eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:44.532290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-932fd42b-9c45-4515-8947-ea0b8a96a3eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:44.532720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-932fd42b-9c45-4515-8947-ea0b8a96a3eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:44.560496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-932fd42b-9c45-4515-8947-ea0b8a96a3eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041519 Jul 20 13:53:44.561045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 404/801] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:44.982368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:44.982971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:44.989400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:44.989844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:44.990600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:44.991030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:45.133259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:45.141351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1859b3bc-81c5-4bf3-b9f6-508470570cb9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.163367 Jul 20 13:53:45.141919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 398/802] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:45.572132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f76f9a2f-d44f-4d77-ae14-4f5bb8c2260a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:45.573087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f76f9a2f-d44f-4d77-ae14-4f5bb8c2260a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:45.580427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76f9a2f-d44f-4d77-ae14-4f5bb8c2260a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:45.580877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76f9a2f-d44f-4d77-ae14-4f5bb8c2260a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:45.581636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76f9a2f-d44f-4d77-ae14-4f5bb8c2260a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:45.582066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76f9a2f-d44f-4d77-ae14-4f5bb8c2260a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:45.610486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f76f9a2f-d44f-4d77-ae14-4f5bb8c2260a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042342 Jul 20 13:53:45.611036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 405/803] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:45.828884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:53:45.829063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 13:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:53:46.158036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:46.158670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:46.165133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:46.165581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:46.166340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:46.166773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:46.295008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:46.302404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2071fb7a-e978-4836-967e-adc172615637 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148236 Jul 20 13:53:46.302965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 399/804] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:46.622056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1646f3ff-485f-4b5c-98ad-5a4d37be5e7a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:46.622968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1646f3ff-485f-4b5c-98ad-5a4d37be5e7a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:46.630357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1646f3ff-485f-4b5c-98ad-5a4d37be5e7a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:46.634892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1646f3ff-485f-4b5c-98ad-5a4d37be5e7a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:46.634892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1646f3ff-485f-4b5c-98ad-5a4d37be5e7a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:46.634892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1646f3ff-485f-4b5c-98ad-5a4d37be5e7a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:46.666469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1646f3ff-485f-4b5c-98ad-5a4d37be5e7a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048316 Jul 20 13:53:46.667020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 406/805] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:47.319940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:47.320579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:47.327577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:47.328023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:47.328806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:47.329240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:47.458230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:47.465623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a9ec7c9c-d132-47ba-a864-b2c14bf7c91d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149522 Jul 20 13:53:47.466186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 400/806] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:47.678987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f6ebbb3-79bc-4080-afaf-8514134377dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:47.679894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7f6ebbb3-79bc-4080-afaf-8514134377dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:47.687126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6ebbb3-79bc-4080-afaf-8514134377dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:47.687571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6ebbb3-79bc-4080-afaf-8514134377dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:47.688371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6ebbb3-79bc-4080-afaf-8514134377dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:47.688807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6ebbb3-79bc-4080-afaf-8514134377dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:47.716382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7f6ebbb3-79bc-4080-afaf-8514134377dd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041418 Jul 20 13:53:47.716914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 407/807] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:48.483031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:48.483711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:48.490651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:48.491099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:48.491885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:48.492359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:48.621995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:48.629548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-33f67a11-0642-47d8-bbe3-180bec07903e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150920 Jul 20 13:53:48.630149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 401/808] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:48.727992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f06d86ed-b40c-4db0-b5aa-6c5882de7d07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:48.728939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f06d86ed-b40c-4db0-b5aa-6c5882de7d07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:48.736011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f06d86ed-b40c-4db0-b5aa-6c5882de7d07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:48.736491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f06d86ed-b40c-4db0-b5aa-6c5882de7d07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:48.737257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f06d86ed-b40c-4db0-b5aa-6c5882de7d07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:48.737695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f06d86ed-b40c-4db0-b5aa-6c5882de7d07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:48.765350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f06d86ed-b40c-4db0-b5aa-6c5882de7d07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041473 Jul 20 13:53:48.765890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 408/809] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:49.646776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:49.647411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:49.654523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:49.655008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:49.655800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:49.656275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:49.778822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b4f1f86f-4a19-4780-9dd4-f1c190fc9ae0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:49.779746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b4f1f86f-4a19-4780-9dd4-f1c190fc9ae0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:49.786008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:49.786274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4f1f86f-4a19-4780-9dd4-f1c190fc9ae0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:49.786601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4f1f86f-4a19-4780-9dd4-f1c190fc9ae0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:49.787374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4f1f86f-4a19-4780-9dd4-f1c190fc9ae0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:49.787818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4f1f86f-4a19-4780-9dd4-f1c190fc9ae0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:49.791605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:49.793831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-787e7525-fbca-4d15-8886-a30bab2b8bfd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150887 Jul 20 13:53:49.794398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 402/810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:49.818881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b4f1f86f-4a19-4780-9dd4-f1c190fc9ae0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045484 Jul 20 13:53:49.819432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 409/811] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:50.810883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:50.811514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:50.818008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:50.818449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:50.819211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:50.819643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:50.830457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-62fe5cde-7735-4ca3-9a4f-27438ded7dd3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:50.831363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-62fe5cde-7735-4ca3-9a4f-27438ded7dd3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:50.837722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62fe5cde-7735-4ca3-9a4f-27438ded7dd3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:50.838163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62fe5cde-7735-4ca3-9a4f-27438ded7dd3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:50.839638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62fe5cde-7735-4ca3-9a4f-27438ded7dd3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:50.840071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62fe5cde-7735-4ca3-9a4f-27438ded7dd3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:50.868297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-62fe5cde-7735-4ca3-9a4f-27438ded7dd3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041640 Jul 20 13:53:50.868859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 410/812] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:50.952663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:50.960075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7716c65c-6750-4fa4-a57a-1f1d94723c32 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153374 Jul 20 13:53:50.960667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 403/813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:51.880763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-48869373-374d-4d7b-a729-831f599b40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:51.881685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-48869373-374d-4d7b-a729-831f599b40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:51.888245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48869373-374d-4d7b-a729-831f599b40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:51.888674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48869373-374d-4d7b-a729-831f599b40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:51.889447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48869373-374d-4d7b-a729-831f599b40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:51.889892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48869373-374d-4d7b-a729-831f599b40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:51.918941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-48869373-374d-4d7b-a729-831f599b40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042178 Jul 20 13:53:51.919486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 411/814] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:51.976568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:51.977200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:51.984414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:51.984858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:51.985645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:51.986075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:52.114988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:52.123059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c1925ff3-f4dc-40e3-9708-1d11b6879cd6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150320 Jul 20 13:53:52.123623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 404/815] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:52.930551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4f712257-b7f2-411b-a6c3-fe5549481fe4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:52.931464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4f712257-b7f2-411b-a6c3-fe5549481fe4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:52.938511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f712257-b7f2-411b-a6c3-fe5549481fe4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:52.938956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f712257-b7f2-411b-a6c3-fe5549481fe4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:52.939744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f712257-b7f2-411b-a6c3-fe5549481fe4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:52.940176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f712257-b7f2-411b-a6c3-fe5549481fe4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:52.968980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4f712257-b7f2-411b-a6c3-fe5549481fe4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042457 Jul 20 13:53:52.969519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 412/816] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:53.140493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:53.141101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:53.147454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:53.147900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:53.148680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:53.149111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:53.278694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:53.286134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d82f7db4-fc34-4bb1-8992-6bc17b6a729d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149523 Jul 20 13:53:53.286696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 405/817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:53.981345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3dae70e6-0030-46c0-bc48-031a803aec66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:53.982263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3dae70e6-0030-46c0-bc48-031a803aec66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:53.988716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3dae70e6-0030-46c0-bc48-031a803aec66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:53.989168 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3dae70e6-0030-46c0-bc48-031a803aec66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:53.989937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3dae70e6-0030-46c0-bc48-031a803aec66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:53.990401 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3dae70e6-0030-46c0-bc48-031a803aec66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:54.018575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3dae70e6-0030-46c0-bc48-031a803aec66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041940 Jul 20 13:53:54.019113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 413/818] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:54.302799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:54.303347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:54.310289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:54.310728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:54.311480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:54.311913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:54.438809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:54.446552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5c319e58-73f9-4ee8-a02e-5db2c02ea37a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147628 Jul 20 13:53:54.447121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 406/819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:55.030292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-85788089-0569-48a4-9959-bc9f29929f4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:55.031904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-85788089-0569-48a4-9959-bc9f29929f4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:55.038398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85788089-0569-48a4-9959-bc9f29929f4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:55.038846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85788089-0569-48a4-9959-bc9f29929f4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:55.039613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85788089-0569-48a4-9959-bc9f29929f4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:55.040050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85788089-0569-48a4-9959-bc9f29929f4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:55.068957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-85788089-0569-48a4-9959-bc9f29929f4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042747 Jul 20 13:53:55.069509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 414/820] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:55.463736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:55.464391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:55.470869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:55.471307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:55.472090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:55.472558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:55.603384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:55.610882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ffc89143-695c-4431-beef-73abeb703274 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150976 Jul 20 13:53:55.611450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 407/821] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:56.080478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a87701de-00ea-412c-9457-18ac5ff2647a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:56.081392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a87701de-00ea-412c-9457-18ac5ff2647a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:56.087779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a87701de-00ea-412c-9457-18ac5ff2647a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:56.088243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a87701de-00ea-412c-9457-18ac5ff2647a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:56.089643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a87701de-00ea-412c-9457-18ac5ff2647a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:56.090074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a87701de-00ea-412c-9457-18ac5ff2647a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:56.117770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a87701de-00ea-412c-9457-18ac5ff2647a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041313 Jul 20 13:53:56.118291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 415/822] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:53:56.628593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:56.629196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:56.635703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:56.636141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:56.636953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:56.637387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:56.766709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:56.774060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8f07bb65-b228-48b6-bd6f-84b2125c2bd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149527 Jul 20 13:53:56.774703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 408/823] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:57.129962 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-387f4c2a-b766-41a4-9a63-5ce203c3e925 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:57.130879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-387f4c2a-b766-41a4-9a63-5ce203c3e925 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:57.137316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-387f4c2a-b766-41a4-9a63-5ce203c3e925 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:57.137767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-387f4c2a-b766-41a4-9a63-5ce203c3e925 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:57.138531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-387f4c2a-b766-41a4-9a63-5ce203c3e925 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:57.138964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-387f4c2a-b766-41a4-9a63-5ce203c3e925 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:57.168015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-387f4c2a-b766-41a4-9a63-5ce203c3e925 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042034 Jul 20 13:53:57.168597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 416/824] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:57.791074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:57.791704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:57.798082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:57.798547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:57.799301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:57.799748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:57.933670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:57.941056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5835fa93-3b6d-4309-9ad1-8d115a02004c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153856 Jul 20 13:53:57.941595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 409/825] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:58.179617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f198da8f-9b0a-49fe-82b5-3fb3aed85aaa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:58.180483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f198da8f-9b0a-49fe-82b5-3fb3aed85aaa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:58.187350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f198da8f-9b0a-49fe-82b5-3fb3aed85aaa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:58.187802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f198da8f-9b0a-49fe-82b5-3fb3aed85aaa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:58.188582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f198da8f-9b0a-49fe-82b5-3fb3aed85aaa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:58.189011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f198da8f-9b0a-49fe-82b5-3fb3aed85aaa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:58.216651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f198da8f-9b0a-49fe-82b5-3fb3aed85aaa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041049 Jul 20 13:53:58.217185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 417/826] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:53:58.958886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:58.959495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:58.966092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:58.966539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:58.967307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:58.967746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:59.100841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:53:59.108830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0e5501bb-6aa2-4960-8ca6-90aef4643259 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153796 Jul 20 13:53:59.109395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 410/827] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:53:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:53:59.228173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-93af5f82-bdfa-4e8e-b589-eea16e0ba54d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:53:59.229894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-93af5f82-bdfa-4e8e-b589-eea16e0ba54d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:53:59.236485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93af5f82-bdfa-4e8e-b589-eea16e0ba54d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:59.236932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93af5f82-bdfa-4e8e-b589-eea16e0ba54d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:59.238049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93af5f82-bdfa-4e8e-b589-eea16e0ba54d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:53:59.238170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93af5f82-bdfa-4e8e-b589-eea16e0ba54d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:53:59.269958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-93af5f82-bdfa-4e8e-b589-eea16e0ba54d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045497 Jul 20 13:53:59.270523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 418/828] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:53:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:00.126307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:00.126915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:00.133353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:00.133798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:00.134552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:00.134981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:00.270215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:00.278034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-21976c36-b8d8-4f14-a4a8-c08ea8dde583 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155622 Jul 20 13:54:00.278598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 411/829] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:00.281725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-13c4a61c-b330-4394-b9c9-f1ff792a3ad1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:00.282644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-13c4a61c-b330-4394-b9c9-f1ff792a3ad1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:00.290627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-13c4a61c-b330-4394-b9c9-f1ff792a3ad1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:00.291295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-13c4a61c-b330-4394-b9c9-f1ff792a3ad1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:00.292667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-13c4a61c-b330-4394-b9c9-f1ff792a3ad1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:00.293136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-13c4a61c-b330-4394-b9c9-f1ff792a3ad1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:00.322526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-13c4a61c-b330-4394-b9c9-f1ff792a3ad1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Jul 20 13:54:00.323080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 419/830] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:01.295319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:01.295947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:01.302412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:01.302850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:01.303624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:01.304051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:01.319076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:01.334492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ee8b5845-7127-4c64-96ff-a8e88f7a8696 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:01.335408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ee8b5845-7127-4c64-96ff-a8e88f7a8696 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:01.342141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee8b5845-7127-4c64-96ff-a8e88f7a8696 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:01.342590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee8b5845-7127-4c64-96ff-a8e88f7a8696 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:01.343368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee8b5845-7127-4c64-96ff-a8e88f7a8696 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:01.343804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee8b5845-7127-4c64-96ff-a8e88f7a8696 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:01.374893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ee8b5845-7127-4c64-96ff-a8e88f7a8696 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044380 Jul 20 13:54:01.375627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 420/831] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:01.436616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:01.443996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-71e4f137-90ee-4fb8-8500-c8bdf31ead7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153012 Jul 20 13:54:01.444578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 412/832] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:02.386912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eaf2bf21-a56a-455e-96ac-fb3914eb5802 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:02.387761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eaf2bf21-a56a-455e-96ac-fb3914eb5802 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:02.394215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf21-a56a-455e-96ac-fb3914eb5802 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:02.394659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf21-a56a-455e-96ac-fb3914eb5802 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:02.395423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf21-a56a-455e-96ac-fb3914eb5802 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:02.395867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf21-a56a-455e-96ac-fb3914eb5802 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:02.424870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eaf2bf21-a56a-455e-96ac-fb3914eb5802 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042081 Jul 20 13:54:02.425407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 421/833] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:02.462273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:02.464107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:02.470618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:02.471066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:02.471832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:02.472294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:02.599767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:02.607737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-77c65329-3eb5-4865-b9d2-685dd3a336c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150053 Jul 20 13:54:02.608348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 413/834] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:03.436827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-476192e1-440a-483c-bdda-c090ec8fddbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:03.437732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-476192e1-440a-483c-bdda-c090ec8fddbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:03.445003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-476192e1-440a-483c-bdda-c090ec8fddbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:03.445448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-476192e1-440a-483c-bdda-c090ec8fddbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:03.446203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-476192e1-440a-483c-bdda-c090ec8fddbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:03.446635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-476192e1-440a-483c-bdda-c090ec8fddbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:03.474733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-476192e1-440a-483c-bdda-c090ec8fddbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041888 Jul 20 13:54:03.475272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 422/835] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:03.624538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:03.625147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:03.631637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:03.632145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:03.632951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:03.633397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:03.760795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:03.768083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c77fcaca-5398-432f-b682-bf35958727a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147370 Jul 20 13:54:03.768698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 414/836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:04.486351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3f5da6ce-1468-4560-b1ca-5e2d251bd374 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:04.487263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3f5da6ce-1468-4560-b1ca-5e2d251bd374 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:04.493679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f5da6ce-1468-4560-b1ca-5e2d251bd374 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:04.494122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f5da6ce-1468-4560-b1ca-5e2d251bd374 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:04.494891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f5da6ce-1468-4560-b1ca-5e2d251bd374 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:04.495322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f5da6ce-1468-4560-b1ca-5e2d251bd374 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:04.523008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3f5da6ce-1468-4560-b1ca-5e2d251bd374 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040659 Jul 20 13:54:04.523552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 423/837] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:04.784689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:04.785232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:04.791866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:04.792349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:04.793113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:04.793545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:04.922345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:04.929708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4a62e9b9-5e14-4e2a-98a0-06b564e74f28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148904 Jul 20 13:54:04.930411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 415/838] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:05.535183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-19c4a5cf-b839-4c50-adad-ab8cecc18820 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:05.536083 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-19c4a5cf-b839-4c50-adad-ab8cecc18820 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:05.542532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19c4a5cf-b839-4c50-adad-ab8cecc18820 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:05.542969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19c4a5cf-b839-4c50-adad-ab8cecc18820 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:05.543732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19c4a5cf-b839-4c50-adad-ab8cecc18820 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:05.544155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19c4a5cf-b839-4c50-adad-ab8cecc18820 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:05.571749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-19c4a5cf-b839-4c50-adad-ab8cecc18820 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040564 Jul 20 13:54:05.572306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 424/839] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:05.946762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:05.947376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:05.955142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:05.955585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:05.956394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:05.956834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:06.089162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:06.096626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-917d27d8-8273-409f-9e9a-9a0f967949e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153677 Jul 20 13:54:06.097194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 416/840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:06.584707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61e9b5fa-699a-48ef-abaa-412a0f41158b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:06.585625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61e9b5fa-699a-48ef-abaa-412a0f41158b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:06.592159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e9b5fa-699a-48ef-abaa-412a0f41158b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:06.592639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e9b5fa-699a-48ef-abaa-412a0f41158b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:06.593401 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e9b5fa-699a-48ef-abaa-412a0f41158b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:06.593838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e9b5fa-699a-48ef-abaa-412a0f41158b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:06.618567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:06.624430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61e9b5fa-699a-48ef-abaa-412a0f41158b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043693 Jul 20 13:54:06.624982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 425/841] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:07.112655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:07.113263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:07.119650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:07.120094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:07.120883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:07.121311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:07.253940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:07.261817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5e3b2396-2007-438d-aac4-972ec3a0e4a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153003 Jul 20 13:54:07.262382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 417/842] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:07.636726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-01529a52-cd1d-4386-898c-803a9fa445a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:07.637245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-01529a52-cd1d-4386-898c-803a9fa445a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:07.643639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01529a52-cd1d-4386-898c-803a9fa445a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:07.644090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01529a52-cd1d-4386-898c-803a9fa445a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:07.644894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01529a52-cd1d-4386-898c-803a9fa445a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:07.645330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01529a52-cd1d-4386-898c-803a9fa445a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:07.675329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-01529a52-cd1d-4386-898c-803a9fa445a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043223 Jul 20 13:54:07.675891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 426/843] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:08.278823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:08.279429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:08.281716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:08.287371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:08.287819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:08.288605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:08.289039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:08.416827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:08.424224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ea97402a-9bdf-4607-896f-328822639e47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149248 Jul 20 13:54:08.424784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 418/844] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:08.687525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c04207ac-d22c-42ef-a7a1-3a59cd0c5ea9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:08.688403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c04207ac-d22c-42ef-a7a1-3a59cd0c5ea9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:08.694892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04207ac-d22c-42ef-a7a1-3a59cd0c5ea9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:08.695336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04207ac-d22c-42ef-a7a1-3a59cd0c5ea9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:08.696100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04207ac-d22c-42ef-a7a1-3a59cd0c5ea9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:08.696561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04207ac-d22c-42ef-a7a1-3a59cd0c5ea9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:08.725214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c04207ac-d22c-42ef-a7a1-3a59cd0c5ea9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041748 Jul 20 13:54:08.725762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 427/845] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:09.441642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:09.442279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:09.449631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:09.450086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:09.450851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:09.451283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:09.582769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:09.591100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4c550c54-7dcc-48fb-b000-c3875a6ff8b9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153251 Jul 20 13:54:09.591685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 419/846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:09.736523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e83dec12-84bc-4513-8dd1-71869428afef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:09.737423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e83dec12-84bc-4513-8dd1-71869428afef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:09.743811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e83dec12-84bc-4513-8dd1-71869428afef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:09.744787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e83dec12-84bc-4513-8dd1-71869428afef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:09.745538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e83dec12-84bc-4513-8dd1-71869428afef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:09.745963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e83dec12-84bc-4513-8dd1-71869428afef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:09.776261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e83dec12-84bc-4513-8dd1-71869428afef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043632 Jul 20 13:54:09.776777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 428/847] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:10.608371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:10.608980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:10.615408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:10.615865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:10.616654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:10.617090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:10.744980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:10.752291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-856a0ec1-d378-4cf5-8e3f-75cf8e6a46f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148451 Jul 20 13:54:10.752854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 420/848] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:10.786829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3442a596-e399-49b7-9f5f-1e12e2dc6300 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:10.787727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3442a596-e399-49b7-9f5f-1e12e2dc6300 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:10.794018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3442a596-e399-49b7-9f5f-1e12e2dc6300 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:10.794456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3442a596-e399-49b7-9f5f-1e12e2dc6300 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:10.795207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3442a596-e399-49b7-9f5f-1e12e2dc6300 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:10.795630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3442a596-e399-49b7-9f5f-1e12e2dc6300 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:10.823754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3442a596-e399-49b7-9f5f-1e12e2dc6300 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040853 Jul 20 13:54:10.824573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 429/849] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:11.769611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:11.770219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:11.776730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:11.777168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:11.778067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:11.778495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:11.835560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-791aaa96-44e1-4f27-9b4f-8a801c92cb89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:11.836501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-791aaa96-44e1-4f27-9b4f-8a801c92cb89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:11.838948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=58 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:11.844159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-791aaa96-44e1-4f27-9b4f-8a801c92cb89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:11.844665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-791aaa96-44e1-4f27-9b4f-8a801c92cb89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:11.845496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-791aaa96-44e1-4f27-9b4f-8a801c92cb89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:11.845909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-791aaa96-44e1-4f27-9b4f-8a801c92cb89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:11.878407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-791aaa96-44e1-4f27-9b4f-8a801c92cb89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046781 Jul 20 13:54:11.878976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 430/850] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:11.909532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:11.917497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17563eee-24e2-4e50-bddc-f7d3cb25ff9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151728 Jul 20 13:54:11.918060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 421/851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:12.890606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cdd9b917-d7dc-4274-bd23-698a15db0502 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:12.891479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cdd9b917-d7dc-4274-bd23-698a15db0502 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:12.897903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdd9b917-d7dc-4274-bd23-698a15db0502 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:12.898336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdd9b917-d7dc-4274-bd23-698a15db0502 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:12.899084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdd9b917-d7dc-4274-bd23-698a15db0502 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:12.899510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdd9b917-d7dc-4274-bd23-698a15db0502 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:12.926955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cdd9b917-d7dc-4274-bd23-698a15db0502 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040418 Jul 20 13:54:12.927484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 431/852] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:12.934892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:12.935498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:12.941871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:12.942327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:12.943081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:12.943513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:13.075877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:13.083431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8dac8563-82d5-4c68-b94f-2d1509a4cdf5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152927 Jul 20 13:54:13.084004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 422/853] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:13.938547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e3939700-b255-40b2-afe8-83b48e43b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:13.939470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e3939700-b255-40b2-afe8-83b48e43b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:13.945923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3939700-b255-40b2-afe8-83b48e43b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:13.946369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3939700-b255-40b2-afe8-83b48e43b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:13.947647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3939700-b255-40b2-afe8-83b48e43b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:13.948084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3939700-b255-40b2-afe8-83b48e43b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:13.977248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e3939700-b255-40b2-afe8-83b48e43b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042722 Jul 20 13:54:13.977793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 432/854] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:14.100284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:14.100909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:14.107416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:14.107863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:14.108659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:14.109092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:14.235853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:14.243552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-722e2151-cef1-4edc-9cfc-521e72ebcc8e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147056 Jul 20 13:54:14.244670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 423/855] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:14.988758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-60118714-a8c4-40d9-ac30-7fe3d8d18bdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:14.989667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-60118714-a8c4-40d9-ac30-7fe3d8d18bdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:14.996662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60118714-a8c4-40d9-ac30-7fe3d8d18bdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:14.997100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60118714-a8c4-40d9-ac30-7fe3d8d18bdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:14.997847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60118714-a8c4-40d9-ac30-7fe3d8d18bdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:14.998273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60118714-a8c4-40d9-ac30-7fe3d8d18bdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:15.026736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-60118714-a8c4-40d9-ac30-7fe3d8d18bdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041928 Jul 20 13:54:15.027277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 433/856] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:15.261680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:15.262210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:15.268696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:15.269142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:15.269901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:15.270335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:15.404207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:15.411828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cb01e60b-25e8-461d-a593-ba4b5c44b14e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154652 Jul 20 13:54:15.412426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 424/857] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:16.038616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-83d69b69-28c9-4985-a7d2-bba771de2b97 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:16.039529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-83d69b69-28c9-4985-a7d2-bba771de2b97 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:16.046001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83d69b69-28c9-4985-a7d2-bba771de2b97 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:16.046443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83d69b69-28c9-4985-a7d2-bba771de2b97 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:16.047204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83d69b69-28c9-4985-a7d2-bba771de2b97 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:16.047637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83d69b69-28c9-4985-a7d2-bba771de2b97 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:16.076376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-83d69b69-28c9-4985-a7d2-bba771de2b97 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041731 Jul 20 13:54:16.076903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 434/858] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:16.433174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:16.433785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:16.440404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:16.440858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:16.441620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:16.442055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:16.569591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:16.577222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0522d0cc-9ada-4f67-8c28-13b949288244 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147917 Jul 20 13:54:16.577784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 425/859] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:17.087124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b19a1fe4-99e7-426f-abf5-46d408a55bbe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:17.088664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b19a1fe4-99e7-426f-abf5-46d408a55bbe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:17.095484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19a1fe4-99e7-426f-abf5-46d408a55bbe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:17.095926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19a1fe4-99e7-426f-abf5-46d408a55bbe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:17.096725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19a1fe4-99e7-426f-abf5-46d408a55bbe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:17.097156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19a1fe4-99e7-426f-abf5-46d408a55bbe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:17.126719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b19a1fe4-99e7-426f-abf5-46d408a55bbe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043563 Jul 20 13:54:17.127269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 435/860] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:17.595100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:17.595707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:17.601672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:17.602118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:17.602874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:17.603305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:17.731162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:17.738591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f83f77db-ffa5-4ce7-abd1-8ddb3474c243 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147525 Jul 20 13:54:17.739153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 426/861] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:18.138090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dd9f040e-c7d4-42cb-af23-e394eecfa07d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:18.139001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dd9f040e-c7d4-42cb-af23-e394eecfa07d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:18.145461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd9f040e-c7d4-42cb-af23-e394eecfa07d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:18.145900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd9f040e-c7d4-42cb-af23-e394eecfa07d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:18.146651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd9f040e-c7d4-42cb-af23-e394eecfa07d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:18.147079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd9f040e-c7d4-42cb-af23-e394eecfa07d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:18.174347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dd9f040e-c7d4-42cb-af23-e394eecfa07d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040925 Jul 20 13:54:18.174878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 436/862] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:18.754924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:18.755444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:18.762404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:18.763409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:18.764163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:18.764613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:18.896449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:18.903832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-853d359e-63c8-433a-8d83-033fc06b9935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152818 Jul 20 13:54:18.904425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 427/863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:19.186526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-543f9dc2-a8c4-4a92-9460-38ea31e525fa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:19.187440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-543f9dc2-a8c4-4a92-9460-38ea31e525fa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:19.193951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543f9dc2-a8c4-4a92-9460-38ea31e525fa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:19.194393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543f9dc2-a8c4-4a92-9460-38ea31e525fa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:19.195155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543f9dc2-a8c4-4a92-9460-38ea31e525fa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:19.195585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543f9dc2-a8c4-4a92-9460-38ea31e525fa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:19.223507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-543f9dc2-a8c4-4a92-9460-38ea31e525fa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041463 Jul 20 13:54:19.224047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 437/864] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:19.921203 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:19.921814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:19.928472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:19.928920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:19.929693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:19.930126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:20.060861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:20.068341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-790dbf16-af5a-4b7d-8bc7-26c7bd88e920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150976 Jul 20 13:54:20.068918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 428/865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:20.235446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-64a8e239-034c-4e95-a325-ffb95e6e8e6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:20.236340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-64a8e239-034c-4e95-a325-ffb95e6e8e6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:20.242748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64a8e239-034c-4e95-a325-ffb95e6e8e6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:20.243188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64a8e239-034c-4e95-a325-ffb95e6e8e6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:20.243942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64a8e239-034c-4e95-a325-ffb95e6e8e6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:20.244398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64a8e239-034c-4e95-a325-ffb95e6e8e6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:20.273907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-64a8e239-034c-4e95-a325-ffb95e6e8e6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042411 Jul 20 13:54:20.274473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 438/866] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:21.085397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:21.086020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:21.092812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:21.093265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:21.094041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:21.094471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:21.097029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:21.230061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:21.237467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-83258902-aee2-4288-91a6-7a6a78098096 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.156072 Jul 20 13:54:21.238035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 429/867] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:54:21.286090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-285cd772-0da6-4cbd-803e-0af8324006d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:21.287005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-285cd772-0da6-4cbd-803e-0af8324006d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:21.293909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-285cd772-0da6-4cbd-803e-0af8324006d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:21.294354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-285cd772-0da6-4cbd-803e-0af8324006d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:21.295109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-285cd772-0da6-4cbd-803e-0af8324006d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:21.295536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-285cd772-0da6-4cbd-803e-0af8324006d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:21.323776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-285cd772-0da6-4cbd-803e-0af8324006d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041626 Jul 20 13:54:21.324603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 439/868] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:22.254962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:22.255568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:22.262638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:22.263082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:22.263839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:22.264294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:22.335103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c02830c2-3e6b-4836-bfd6-f7be747c23cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:22.336012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c02830c2-3e6b-4836-bfd6-f7be747c23cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:22.343227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c02830c2-3e6b-4836-bfd6-f7be747c23cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:22.343674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c02830c2-3e6b-4836-bfd6-f7be747c23cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:22.344481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c02830c2-3e6b-4836-bfd6-f7be747c23cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:22.344916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c02830c2-3e6b-4836-bfd6-f7be747c23cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:22.373884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c02830c2-3e6b-4836-bfd6-f7be747c23cd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042772 Jul 20 13:54:22.374439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 440/869] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:22.392470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:22.400082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3c094d9c-9f98-433c-8b5a-4d1713c52ca0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148935 Jul 20 13:54:22.400700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 430/870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:23.385560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-632c0e2e-3860-4262-97ce-62f805e6f1f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:23.386477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-632c0e2e-3860-4262-97ce-62f805e6f1f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:23.393039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-632c0e2e-3860-4262-97ce-62f805e6f1f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:23.393490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-632c0e2e-3860-4262-97ce-62f805e6f1f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:23.394261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-632c0e2e-3860-4262-97ce-62f805e6f1f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:23.394705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-632c0e2e-3860-4262-97ce-62f805e6f1f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:23.417474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:23.418098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:23.424212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-632c0e2e-3860-4262-97ce-62f805e6f1f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042667 Jul 20 13:54:23.424390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:23.424780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 441/871] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:23.424889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:23.425572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:23.425995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:23.557727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:23.565106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1a72f2d2-7de4-4032-8e69-9e6dbcf4c431 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152096 Jul 20 13:54:23.565669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 431/872] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:54:24.436126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4b995160-6413-4e0a-ac45-a58da2743ba9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:24.437059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4b995160-6413-4e0a-ac45-a58da2743ba9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:24.443408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b995160-6413-4e0a-ac45-a58da2743ba9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:24.443877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b995160-6413-4e0a-ac45-a58da2743ba9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:24.444663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b995160-6413-4e0a-ac45-a58da2743ba9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:24.445107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b995160-6413-4e0a-ac45-a58da2743ba9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:24.459132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:24.474851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4b995160-6413-4e0a-ac45-a58da2743ba9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042949 Jul 20 13:54:24.475555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 442/873] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:24.582398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:24.583005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:24.590099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:24.590538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:24.591289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:24.591714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:24.721559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:24.729001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fec7b375-75ab-488e-bf25-f42cd426da1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150445 Jul 20 13:54:24.729587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 432/874] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:24 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:25.487241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5c142a8c-0099-4961-ab56-1566282932d5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:25.488163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5c142a8c-0099-4961-ab56-1566282932d5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:25.495371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5c142a8c-0099-4961-ab56-1566282932d5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:25.495807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5c142a8c-0099-4961-ab56-1566282932d5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:25.496599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5c142a8c-0099-4961-ab56-1566282932d5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:25.497029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5c142a8c-0099-4961-ab56-1566282932d5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:25.525763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5c142a8c-0099-4961-ab56-1566282932d5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042535 Jul 20 13:54:25.526316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 443/875] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:25.745179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:25.745721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:25.752273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:25.752727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:25.753547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:25.754031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:25.880895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:25.888906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-893a046e-0454-43f5-a774-27ee60d868f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147628 Jul 20 13:54:25.889472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 433/876] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:26.536728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6a1d4006-2e07-44b9-b068-ec481a3ceb22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:26.537657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6a1d4006-2e07-44b9-b068-ec481a3ceb22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:26.544574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a1d4006-2e07-44b9-b068-ec481a3ceb22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:26.545012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a1d4006-2e07-44b9-b068-ec481a3ceb22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:26.545762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a1d4006-2e07-44b9-b068-ec481a3ceb22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:26.546187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a1d4006-2e07-44b9-b068-ec481a3ceb22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:26.574827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6a1d4006-2e07-44b9-b068-ec481a3ceb22 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042196 Jul 20 13:54:26.575372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 444/877] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:26.905744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:26.906362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:26.912839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:26.913293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:26.914063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:26.914499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:27.045146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:27.052451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f1b603fa-6d2f-468e-95b7-d3fd72567345 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150586 Jul 20 13:54:27.053017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 434/878] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:27.586653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5284a6ec-31b5-4a69-b4b4-ad6cc30c7075 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:27.587565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5284a6ec-31b5-4a69-b4b4-ad6cc30c7075 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:27.594070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5284a6ec-31b5-4a69-b4b4-ad6cc30c7075 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:27.594802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5284a6ec-31b5-4a69-b4b4-ad6cc30c7075 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:27.596145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5284a6ec-31b5-4a69-b4b4-ad6cc30c7075 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:27.596941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5284a6ec-31b5-4a69-b4b4-ad6cc30c7075 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:27.632780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5284a6ec-31b5-4a69-b4b4-ad6cc30c7075 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050021 Jul 20 13:54:27.633546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 445/879] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:28.069054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:28.069675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:28.076377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:28.076823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:28.077586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:28.078017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:28.205503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:28.213767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-93605eec-be01-4c8b-af56-07d16b71a261 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148637 Jul 20 13:54:28.214341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 435/880] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:28.644084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-376e23e0-f12a-463f-9f2c-29756117ae05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:28.645033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-376e23e0-f12a-463f-9f2c-29756117ae05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:28.651713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-376e23e0-f12a-463f-9f2c-29756117ae05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:28.652158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-376e23e0-f12a-463f-9f2c-29756117ae05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:28.652946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-376e23e0-f12a-463f-9f2c-29756117ae05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:28.653377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-376e23e0-f12a-463f-9f2c-29756117ae05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:28.682418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-376e23e0-f12a-463f-9f2c-29756117ae05 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042261 Jul 20 13:54:28.682971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 446/881] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:29.231064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:29.231667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:29.238138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:29.238580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:29.239339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:29.239771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:29.371309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:29.378649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-43418de0-9c5d-418c-b80f-6ce9a462d594 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151845 Jul 20 13:54:29.379204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 436/882] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:29.694021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9b3a2932-219d-4156-b310-3a762c2373f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:29.694949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9b3a2932-219d-4156-b310-3a762c2373f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:29.702261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3a2932-219d-4156-b310-3a762c2373f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:29.702711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3a2932-219d-4156-b310-3a762c2373f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:29.703467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3a2932-219d-4156-b310-3a762c2373f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:29.703900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3a2932-219d-4156-b310-3a762c2373f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:29.731997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9b3a2932-219d-4156-b310-3a762c2373f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041949 Jul 20 13:54:29.732572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 447/883] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:30.395995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:30.396633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:30.403175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:30.403620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:30.404422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:30.404852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:30.536478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:30.543912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6f54732d-fa17-4027-96ca-3c2f07e6a260 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151765 Jul 20 13:54:30.544506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 437/884] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:30.743101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c700873d-af21-4b25-a532-f2f2b650c580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:30.744492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c700873d-af21-4b25-a532-f2f2b650c580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:30.750945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c700873d-af21-4b25-a532-f2f2b650c580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:30.751390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c700873d-af21-4b25-a532-f2f2b650c580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:30.752156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c700873d-af21-4b25-a532-f2f2b650c580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:30.752616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c700873d-af21-4b25-a532-f2f2b650c580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:30.781018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c700873d-af21-4b25-a532-f2f2b650c580 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042031 Jul 20 13:54:30.781566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 448/885] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:31.561447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:31.562051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:31.568644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:31.569092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:31.569857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:31.570292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:31.698519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:31.706620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7c9adde6-2fa7-4c28-b9b4-abe16107f8f1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148985 Jul 20 13:54:31.707184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 438/886] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:31.793110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-939870f1-4fbe-45ec-8f65-693fe8b5420e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:31.794019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-939870f1-4fbe-45ec-8f65-693fe8b5420e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:31.800432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-939870f1-4fbe-45ec-8f65-693fe8b5420e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:31.800874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-939870f1-4fbe-45ec-8f65-693fe8b5420e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:31.801649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-939870f1-4fbe-45ec-8f65-693fe8b5420e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:31.802084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-939870f1-4fbe-45ec-8f65-693fe8b5420e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:31.830899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-939870f1-4fbe-45ec-8f65-693fe8b5420e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042259 Jul 20 13:54:31.831370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 449/887] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:32.722800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:32.723341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:32.730260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:32.730720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:32.731488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:32.731919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:32.842558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eb8fb425-512f-4aba-baed-1190469dbc28 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:32.843483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eb8fb425-512f-4aba-baed-1190469dbc28 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:32.858291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb8fb425-512f-4aba-baed-1190469dbc28 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:32.858739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb8fb425-512f-4aba-baed-1190469dbc28 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:32.859515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb8fb425-512f-4aba-baed-1190469dbc28 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:32.859951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb8fb425-512f-4aba-baed-1190469dbc28 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:32.862710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:32.870680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-22486f3f-ad2a-4534-af77-8addd32bdedf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151741 Jul 20 13:54:32.871245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 439/888] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:32.890367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eb8fb425-512f-4aba-baed-1190469dbc28 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051862 Jul 20 13:54:32.890919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 450/889] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:33.886866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:33.887419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:33.893845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:33.894293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:33.895050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:33.895480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:33.902268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aa7b31fe-4e44-41d6-bf90-c438132a3f84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:33.903173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aa7b31fe-4e44-41d6-bf90-c438132a3f84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:33.909761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa7b31fe-4e44-41d6-bf90-c438132a3f84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:33.910210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa7b31fe-4e44-41d6-bf90-c438132a3f84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:33.911001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa7b31fe-4e44-41d6-bf90-c438132a3f84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:33.911462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa7b31fe-4e44-41d6-bf90-c438132a3f84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:33.940748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aa7b31fe-4e44-41d6-bf90-c438132a3f84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042849 Jul 20 13:54:33.941320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 451/890] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:34.023023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:34.031042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d54910ca-ee26-4523-969b-70af7adcf4cd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148115 Jul 20 13:54:34.031607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 440/891] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:34.952292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9c421d50-8f49-4c40-b9a9-9c68beb1f4c4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:34.953279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9c421d50-8f49-4c40-b9a9-9c68beb1f4c4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:34.959734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9c421d50-8f49-4c40-b9a9-9c68beb1f4c4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:34.960185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9c421d50-8f49-4c40-b9a9-9c68beb1f4c4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:34.960993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9c421d50-8f49-4c40-b9a9-9c68beb1f4c4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:34.961432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9c421d50-8f49-4c40-b9a9-9c68beb1f4c4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:34.990953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9c421d50-8f49-4c40-b9a9-9c68beb1f4c4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042878 Jul 20 13:54:34.991503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 452/892] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:35.048094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:35.048726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:35.055141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:35.056313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:35.057077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:35.057509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:35.188810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:35.196107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d55a1617-d782-4660-9e2c-2ee5bd28d119 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151904 Jul 20 13:54:35.196703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 441/893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:36.002856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-84e6a454-a03d-46c3-8819-8bee01350a03 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:36.003777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-84e6a454-a03d-46c3-8819-8bee01350a03 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:36.010226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84e6a454-a03d-46c3-8819-8bee01350a03 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:36.010674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84e6a454-a03d-46c3-8819-8bee01350a03 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:36.011446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84e6a454-a03d-46c3-8819-8bee01350a03 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:36.011876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84e6a454-a03d-46c3-8819-8bee01350a03 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:36.040810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-84e6a454-a03d-46c3-8819-8bee01350a03 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041276 Jul 20 13:54:36.041353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 453/894] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:36.213393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:36.214001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:36.220479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:36.220924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:36.221684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:36.222117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:36.350435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:36.357698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2d401875-04dd-4692-a44d-357ff39b7280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148691 Jul 20 13:54:36.358256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 442/895] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:37.052458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d23da03c-b7e1-4912-bfc0-a13196ade45e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:37.053373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d23da03c-b7e1-4912-bfc0-a13196ade45e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:37.059673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d23da03c-b7e1-4912-bfc0-a13196ade45e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:37.060113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d23da03c-b7e1-4912-bfc0-a13196ade45e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:37.060979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d23da03c-b7e1-4912-bfc0-a13196ade45e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:37.061370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d23da03c-b7e1-4912-bfc0-a13196ade45e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:37.090595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d23da03c-b7e1-4912-bfc0-a13196ade45e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042163 Jul 20 13:54:37.091133 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 454/896] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:37.375485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:37.376023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:37.382488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:37.382929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:37.383686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:37.384115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:37.513845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:37.521345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c5fa3d68-d26b-436f-b586-8fe6e1ed5476 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149797 Jul 20 13:54:37.521908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 443/897] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:38.102124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-044ffd10-0d6d-4824-b526-94ff8cc77bc2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:38.103133 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-044ffd10-0d6d-4824-b526-94ff8cc77bc2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:38.109610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-044ffd10-0d6d-4824-b526-94ff8cc77bc2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:38.110052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-044ffd10-0d6d-4824-b526-94ff8cc77bc2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:38.110812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-044ffd10-0d6d-4824-b526-94ff8cc77bc2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:38.111242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-044ffd10-0d6d-4824-b526-94ff8cc77bc2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:38.139946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-044ffd10-0d6d-4824-b526-94ff8cc77bc2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041780 Jul 20 13:54:38.140514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 455/898] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:38.538875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:38.539462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:38.541792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:38.546879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:38.547323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:38.548080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:38.548528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:38.678831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:38.686230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bf8ebc54-a99b-41b4-aa34-1156ed6f7a7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151271 Jul 20 13:54:38.686787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 444/899] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:39.151697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4cdae01a-730a-424b-9ef0-1bba6c769e52 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:39.152617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4cdae01a-730a-424b-9ef0-1bba6c769e52 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:39.158962 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cdae01a-730a-424b-9ef0-1bba6c769e52 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:39.159398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cdae01a-730a-424b-9ef0-1bba6c769e52 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:39.160148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cdae01a-730a-424b-9ef0-1bba6c769e52 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:39.160598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cdae01a-730a-424b-9ef0-1bba6c769e52 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:39.188795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4cdae01a-730a-424b-9ef0-1bba6c769e52 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041130 Jul 20 13:54:39.189331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 456/900] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:39.703439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:39.704049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:39.710518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:39.710966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:39.712282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:39.712718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:39.841532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:39.843767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:39.850095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae9d29f3-6120-4079-a238-01e1109bb506 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150862 Jul 20 13:54:39.850661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 445/901] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:40.200646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-184a7987-4c01-47b2-9a0e-11827874df32 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:40.201561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-184a7987-4c01-47b2-9a0e-11827874df32 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:40.208046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184a7987-4c01-47b2-9a0e-11827874df32 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:40.208524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184a7987-4c01-47b2-9a0e-11827874df32 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:40.209330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184a7987-4c01-47b2-9a0e-11827874df32 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:40.209806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-184a7987-4c01-47b2-9a0e-11827874df32 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:40.238407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-184a7987-4c01-47b2-9a0e-11827874df32 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042032 Jul 20 13:54:40.238948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 457/902] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:40.867689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:40.869707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:40.876280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:40.876729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:40.877497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:40.877930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:41.013381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:41.020833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-51bf6862-e237-476d-bf6b-76696a9de0e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.157068 Jul 20 13:54:41.021406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 446/903] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:41.250116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff2cab1a-886c-4e45-b1b3-9737d39a403c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:41.251003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff2cab1a-886c-4e45-b1b3-9737d39a403c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:41.257490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff2cab1a-886c-4e45-b1b3-9737d39a403c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:41.257933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff2cab1a-886c-4e45-b1b3-9737d39a403c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:41.258688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff2cab1a-886c-4e45-b1b3-9737d39a403c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:41.259118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff2cab1a-886c-4e45-b1b3-9737d39a403c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:41.287752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff2cab1a-886c-4e45-b1b3-9737d39a403c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041753 Jul 20 13:54:41.288334 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 458/904] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:42.037928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:42.038528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:42.045220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:42.045683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:42.046457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:42.046899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:42.175414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:42.183613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-16dd8bd3-ebb5-45d3-bfad-d1d01f84e024 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149591 Jul 20 13:54:42.184177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 447/905] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:42.300785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dd4a591e-5117-4dc8-ac20-cce4f13cd7f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:42.301625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dd4a591e-5117-4dc8-ac20-cce4f13cd7f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:42.303870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=58 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:42.309668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd4a591e-5117-4dc8-ac20-cce4f13cd7f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:42.310085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd4a591e-5117-4dc8-ac20-cce4f13cd7f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:42.310845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd4a591e-5117-4dc8-ac20-cce4f13cd7f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:42.311390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd4a591e-5117-4dc8-ac20-cce4f13cd7f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:42.315366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:42.340518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dd4a591e-5117-4dc8-ac20-cce4f13cd7f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043669 Jul 20 13:54:42.341063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 459/906] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:43.200239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:43.200849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:43.207251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:43.207697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:43.208488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:43.208920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:43.341780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:43.349185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8a96c315-01bd-4a38-b51d-b174e0c7d1fb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153110 Jul 20 13:54:43.349745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 448/907] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:43.352703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-12267050-4906-467a-9f2d-f48eeb8f402c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:43.353630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-12267050-4906-467a-9f2d-f48eeb8f402c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:43.360063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12267050-4906-467a-9f2d-f48eeb8f402c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:43.360546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12267050-4906-467a-9f2d-f48eeb8f402c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:43.361319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12267050-4906-467a-9f2d-f48eeb8f402c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:43.361777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12267050-4906-467a-9f2d-f48eeb8f402c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:43.390495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-12267050-4906-467a-9f2d-f48eeb8f402c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042279 Jul 20 13:54:43.390974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 460/908] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:44.365628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:44.366239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:44.373282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:44.373742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:44.374484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:44.374918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:44.402046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bf2cb15b-1147-4d47-a125-a7ae22128681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:44.403024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bf2cb15b-1147-4d47-a125-a7ae22128681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:44.409491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf2cb15b-1147-4d47-a125-a7ae22128681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:44.409937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf2cb15b-1147-4d47-a125-a7ae22128681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:44.410705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf2cb15b-1147-4d47-a125-a7ae22128681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:44.411135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bf2cb15b-1147-4d47-a125-a7ae22128681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:44.440642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bf2cb15b-1147-4d47-a125-a7ae22128681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042437 Jul 20 13:54:44.441205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 461/909] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:44.502468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:44.510642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1e05d848-532b-4e51-ac10-7c8197bc8bcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148910 Jul 20 13:54:44.511198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 449/910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:45.451873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-63ca4b73-a209-435b-9e02-55f264d99e79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:45.452812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-63ca4b73-a209-435b-9e02-55f264d99e79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:45.459238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-63ca4b73-a209-435b-9e02-55f264d99e79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:45.459700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-63ca4b73-a209-435b-9e02-55f264d99e79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:45.460475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-63ca4b73-a209-435b-9e02-55f264d99e79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:45.460904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-63ca4b73-a209-435b-9e02-55f264d99e79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:45.489701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-63ca4b73-a209-435b-9e02-55f264d99e79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042206 Jul 20 13:54:45.490258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 462/911] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:45.528448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:45.529069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:45.535631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:45.536080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:45.536909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:45.537341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:45.667570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:45.674931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe2a8285-fbf2-4688-84fc-380c692f71c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150972 Jul 20 13:54:45.675513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 450/912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:46.502028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fc735d26-76ce-468d-8ad1-788420e64924 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:46.502880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fc735d26-76ce-468d-8ad1-788420e64924 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:46.509919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc735d26-76ce-468d-8ad1-788420e64924 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:46.510364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc735d26-76ce-468d-8ad1-788420e64924 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:46.511123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc735d26-76ce-468d-8ad1-788420e64924 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:46.511560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc735d26-76ce-468d-8ad1-788420e64924 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:46.539399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fc735d26-76ce-468d-8ad1-788420e64924 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041536 Jul 20 13:54:46.539941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 463/913] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:46.692466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:46.693080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:46.700399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:46.700843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:46.701627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:46.702097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:46.839660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:46.847209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1be007b7-ad8e-4a5a-afbe-b89f1e34bf3e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.158751 Jul 20 13:54:46.847777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 451/914] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:47.551446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-960e1b6f-e560-465e-949a-6530b6dbd633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:47.552386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-960e1b6f-e560-465e-949a-6530b6dbd633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:47.559517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-960e1b6f-e560-465e-949a-6530b6dbd633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:47.559955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-960e1b6f-e560-465e-949a-6530b6dbd633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:47.560732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-960e1b6f-e560-465e-949a-6530b6dbd633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:47.561159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-960e1b6f-e560-465e-949a-6530b6dbd633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:47.589638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-960e1b6f-e560-465e-949a-6530b6dbd633 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042111 Jul 20 13:54:47.590185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 464/915] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:47.864609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:47.865180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:47.871798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:47.872273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:47.873042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:47.873474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:47.999360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:48.006781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d1337500-691c-468e-91ad-1f76b3d9ba00 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.146331 Jul 20 13:54:48.007347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 452/916] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:48.601541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4f670ae2-d822-4257-9d5c-0e45881925df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:48.602997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4f670ae2-d822-4257-9d5c-0e45881925df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:48.609449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f670ae2-d822-4257-9d5c-0e45881925df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:48.609904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f670ae2-d822-4257-9d5c-0e45881925df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:48.610667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f670ae2-d822-4257-9d5c-0e45881925df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:48.611115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f670ae2-d822-4257-9d5c-0e45881925df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:48.640061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4f670ae2-d822-4257-9d5c-0e45881925df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042523 Jul 20 13:54:48.640665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 465/917] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:49.024175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:49.024829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:49.031244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:49.031687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:49.032484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:49.032917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:49.163114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:49.171073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-137009e4-e84a-44fa-8758-64bab717e747 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150747 Jul 20 13:54:49.171640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 453/918] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:49.651706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7906eeb4-2246-4741-b8b5-87666db905bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:49.652688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7906eeb4-2246-4741-b8b5-87666db905bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:49.659225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7906eeb4-2246-4741-b8b5-87666db905bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:49.659670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7906eeb4-2246-4741-b8b5-87666db905bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:49.660461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7906eeb4-2246-4741-b8b5-87666db905bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:49.660896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7906eeb4-2246-4741-b8b5-87666db905bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:49.689186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7906eeb4-2246-4741-b8b5-87666db905bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041484 Jul 20 13:54:49.689734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 466/919] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:50.188141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:50.188795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:50.195260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:50.196408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:50.197177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:50.197610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:50.325064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:50.332500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8014bf02-56af-4411-911b-7a4f3bde9f3d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148171 Jul 20 13:54:50.333066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 454/920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:50.700210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e9af89fb-c143-4bd5-a320-92429377c772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:50.701140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e9af89fb-c143-4bd5-a320-92429377c772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:50.707677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9af89fb-c143-4bd5-a320-92429377c772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:50.708124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9af89fb-c143-4bd5-a320-92429377c772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:50.709069 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9af89fb-c143-4bd5-a320-92429377c772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:50.709501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9af89fb-c143-4bd5-a320-92429377c772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:50.737725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e9af89fb-c143-4bd5-a320-92429377c772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041784 Jul 20 13:54:50.738268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 467/921] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:51.348795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:51.349402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:51.356841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:51.357291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:51.358086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:51.358523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:51.490798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:51.498800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-55e259f8-8cbb-4540-a1cd-7ff3481f20f2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153874 Jul 20 13:54:51.499367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 455/922] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:51.749486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-af36147f-5368-4a51-9ab6-b3e1aa9382ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:51.750403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-af36147f-5368-4a51-9ab6-b3e1aa9382ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:51.756897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af36147f-5368-4a51-9ab6-b3e1aa9382ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:51.757344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af36147f-5368-4a51-9ab6-b3e1aa9382ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:51.758125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af36147f-5368-4a51-9ab6-b3e1aa9382ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:51.758592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af36147f-5368-4a51-9ab6-b3e1aa9382ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:51.787315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-af36147f-5368-4a51-9ab6-b3e1aa9382ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041817 Jul 20 13:54:51.787914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 468/923] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:52.516544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:52.517125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:52.523391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:52.524357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:52.525116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:52.525540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:52.659500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:52.667628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-253a97ab-545d-467a-9e31-02a90bb9882d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155180 Jul 20 13:54:52.668210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 456/924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:52.799917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f5d61981-188d-4fd6-8fc8-02645a7d7749 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:52.800772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f5d61981-188d-4fd6-8fc8-02645a7d7749 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:52.807872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5d61981-188d-4fd6-8fc8-02645a7d7749 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:52.808348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5d61981-188d-4fd6-8fc8-02645a7d7749 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:52.809111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5d61981-188d-4fd6-8fc8-02645a7d7749 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:52.809541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5d61981-188d-4fd6-8fc8-02645a7d7749 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:52.837745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f5d61981-188d-4fd6-8fc8-02645a7d7749 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041929 Jul 20 13:54:52.838278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 469/925] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:53.685364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:53.685980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:53.692562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:53.693012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:53.693792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:53.694254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:53.823920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:53.831765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a5e25a7b-5864-4890-87c9-9913b212cbff tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150396 Jul 20 13:54:53.832390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 457/926] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:53.849395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c312b930-6d19-4a55-935c-a2c62e12988e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:53.850350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c312b930-6d19-4a55-935c-a2c62e12988e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:53.857369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c312b930-6d19-4a55-935c-a2c62e12988e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:53.857840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c312b930-6d19-4a55-935c-a2c62e12988e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:53.858648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c312b930-6d19-4a55-935c-a2c62e12988e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:53.859107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c312b930-6d19-4a55-935c-a2c62e12988e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:53.888474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c312b930-6d19-4a55-935c-a2c62e12988e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043013 Jul 20 13:54:53.888985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 470/927] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:54.849075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:54.849681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:54.856641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:54.857088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:54.857840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:54.858266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:54.900336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0e28c249-bc52-4f06-8a86-d294d508bb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:54.901259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0e28c249-bc52-4f06-8a86-d294d508bb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:54.907678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0e28c249-bc52-4f06-8a86-d294d508bb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:54.908124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0e28c249-bc52-4f06-8a86-d294d508bb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:54.908924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0e28c249-bc52-4f06-8a86-d294d508bb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:54.909355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0e28c249-bc52-4f06-8a86-d294d508bb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:54.938398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0e28c249-bc52-4f06-8a86-d294d508bb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042560 Jul 20 13:54:54.939103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 471/928] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:54:54.993183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:55.000596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-674937f5-98c8-4d82-934f-3cd0c4b4b82c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155299 Jul 20 13:54:55.001159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 458/929] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:55.950274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e459dcbe-f3d3-40de-a086-272d68314b04 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:55.951187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e459dcbe-f3d3-40de-a086-272d68314b04 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:55.957702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e459dcbe-f3d3-40de-a086-272d68314b04 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:55.958151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e459dcbe-f3d3-40de-a086-272d68314b04 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:55.958917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e459dcbe-f3d3-40de-a086-272d68314b04 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:55.959356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e459dcbe-f3d3-40de-a086-272d68314b04 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:55.987951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e459dcbe-f3d3-40de-a086-272d68314b04 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041925 Jul 20 13:54:55.988535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 472/930] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:56.017919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:56.018526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:56.024991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:56.025437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:56.026199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:56.026626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:56.154756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:56.162294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-757b065b-85d1-4ff4-adc0-dda712e58b1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148200 Jul 20 13:54:56.162866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 459/931] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:56.999362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-96894648-1e5f-4889-8437-4c57503ecc8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:57.000296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-96894648-1e5f-4889-8437-4c57503ecc8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:57.006692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96894648-1e5f-4889-8437-4c57503ecc8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:57.007156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96894648-1e5f-4889-8437-4c57503ecc8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:57.008553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96894648-1e5f-4889-8437-4c57503ecc8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:57.008957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96894648-1e5f-4889-8437-4c57503ecc8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:57.036499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-96894648-1e5f-4889-8437-4c57503ecc8f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041106 Jul 20 13:54:57.037028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 473/932] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:57.180536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:57.181145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:57.187529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:57.187980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:57.188781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:57.189224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:57.319378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:57.327134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef1a3be3-1505-4d6e-a65c-dbe3b191ae26 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151088 Jul 20 13:54:57.327699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 460/933] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:58.048901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a5c3f0b8-22db-4f66-a03f-cc2f86c43b99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:58.049842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a5c3f0b8-22db-4f66-a03f-cc2f86c43b99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:58.056590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c3f0b8-22db-4f66-a03f-cc2f86c43b99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:58.057039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c3f0b8-22db-4f66-a03f-cc2f86c43b99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:58.057820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c3f0b8-22db-4f66-a03f-cc2f86c43b99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:58.058261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c3f0b8-22db-4f66-a03f-cc2f86c43b99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:58.087354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a5c3f0b8-22db-4f66-a03f-cc2f86c43b99 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042913 Jul 20 13:54:58.087914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 474/934] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:58.344150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:58.344765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:58.352869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:58.353315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:58.354084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:58.354516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:58.484679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:58.492059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b0d2f3e7-e22d-48f0-803a-b2a705ba327b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151833 Jul 20 13:54:58.492644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 461/935] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:54:59.099096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f68e2db5-2578-407d-9013-f0635876d9e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:59.100003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f68e2db5-2578-407d-9013-f0635876d9e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:59.106375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e2db5-2578-407d-9013-f0635876d9e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:59.106815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e2db5-2578-407d-9013-f0635876d9e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:59.107565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e2db5-2578-407d-9013-f0635876d9e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:59.107989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e2db5-2578-407d-9013-f0635876d9e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:59.131988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:59.137426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f68e2db5-2578-407d-9013-f0635876d9e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042331 Jul 20 13:54:59.137963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 475/936] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:54:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:54:59.510307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:54:59.510908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:54:59.517406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:59.517858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:59.518620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:54:59.519054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:54:59.534230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:54:59.649868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:54:59.657318 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1e3d2746-ba50-4f65-9c0a-0b135d686dcb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151427 Jul 20 13:54:59.657883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 462/937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:54:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:00.149164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cfbc34af-db57-4b72-9190-e6479436f613 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:00.150078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cfbc34af-db57-4b72-9190-e6479436f613 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:00.156923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfbc34af-db57-4b72-9190-e6479436f613 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:00.157366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfbc34af-db57-4b72-9190-e6479436f613 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:00.158126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfbc34af-db57-4b72-9190-e6479436f613 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:00.158555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cfbc34af-db57-4b72-9190-e6479436f613 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:00.186948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cfbc34af-db57-4b72-9190-e6479436f613 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041780 Jul 20 13:55:00.187489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 476/938] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:00.674213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:00.674821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:00.681825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:00.682273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:00.683032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:00.683462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:00.818773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:00.827056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-86559689-2617-4b96-b1ba-bd67cc79a002 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.156712 Jul 20 13:55:00.827617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 463/939] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:01.199683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c8fe9b0d-bd00-45d6-88d9-db188275b1de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:01.200620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c8fe9b0d-bd00-45d6-88d9-db188275b1de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:01.207131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8fe9b0d-bd00-45d6-88d9-db188275b1de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:01.207569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8fe9b0d-bd00-45d6-88d9-db188275b1de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:01.208358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8fe9b0d-bd00-45d6-88d9-db188275b1de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:01.208785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8fe9b0d-bd00-45d6-88d9-db188275b1de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:01.237201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c8fe9b0d-bd00-45d6-88d9-db188275b1de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042343 Jul 20 13:55:01.237737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 477/940] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:01.844691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:01.845308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:01.852350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:01.852802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:01.853568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:01.854009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:01.984385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:01.991856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-442ba4d2-aa4a-4b49-adcd-48dd9c541cd1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151025 Jul 20 13:55:01.993029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 464/941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:02.248400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5cd53a61-e1be-4750-b6d5-548ae5e407db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:02.249246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5cd53a61-e1be-4750-b6d5-548ae5e407db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:02.255600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cd53a61-e1be-4750-b6d5-548ae5e407db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:02.256046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cd53a61-e1be-4750-b6d5-548ae5e407db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:02.256839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cd53a61-e1be-4750-b6d5-548ae5e407db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:02.257269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5cd53a61-e1be-4750-b6d5-548ae5e407db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:02.285372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5cd53a61-e1be-4750-b6d5-548ae5e407db tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041156 Jul 20 13:55:02.285912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 478/942] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:03.114840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:03.115440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:03.121849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:03.122289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:03.123084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:03.123508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:03.297692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-36ddd722-8d3a-4a1d-9d92-cf32f8844042 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:03.298507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-36ddd722-8d3a-4a1d-9d92-cf32f8844042 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:03.305522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ddd722-8d3a-4a1d-9d92-cf32f8844042 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:03.305961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ddd722-8d3a-4a1d-9d92-cf32f8844042 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:03.306726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ddd722-8d3a-4a1d-9d92-cf32f8844042 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:03.307151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36ddd722-8d3a-4a1d-9d92-cf32f8844042 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:03.336035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-36ddd722-8d3a-4a1d-9d92-cf32f8844042 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042327 Jul 20 13:55:03.336618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 479/943] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:03.629158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:03.637413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7e66da68-bc0b-43b7-aca8-e858f15c4fe2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.626861 Jul 20 13:55:03.637996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 465/944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:04.347610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9ae64778-6db7-4801-841f-0ba66d750e07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:04.348535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9ae64778-6db7-4801-841f-0ba66d750e07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:04.355412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ae64778-6db7-4801-841f-0ba66d750e07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:04.355850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ae64778-6db7-4801-841f-0ba66d750e07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:04.356636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ae64778-6db7-4801-841f-0ba66d750e07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:04.357063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ae64778-6db7-4801-841f-0ba66d750e07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:04.385157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9ae64778-6db7-4801-841f-0ba66d750e07 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041542 Jul 20 13:55:04.385696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 480/945] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:04.655026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:04.655642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:04.662111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:04.662558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:04.663317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:04.664442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:04.790191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:04.797555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-047f2e03-cf28-4b9e-85ad-ae0faf96be72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.146413 Jul 20 13:55:04.798126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 466/946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:55:05.396825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0fcbc68a-767c-46e6-8dfc-df85f46a095d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:05.397728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0fcbc68a-767c-46e6-8dfc-df85f46a095d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:05.404618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fcbc68a-767c-46e6-8dfc-df85f46a095d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:05.405064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fcbc68a-767c-46e6-8dfc-df85f46a095d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:05.405814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fcbc68a-767c-46e6-8dfc-df85f46a095d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:05.406241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fcbc68a-767c-46e6-8dfc-df85f46a095d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:05.434505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0fcbc68a-767c-46e6-8dfc-df85f46a095d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041665 Jul 20 13:55:05.435123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 481/947] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:05.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:05.815159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:05.821656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:05.822099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:05.822858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:05.823294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:05.952450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:05.961397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cf2d7957-d33a-4f13-85a8-75b531988845 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150566 Jul 20 13:55:05.962020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 467/948] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:06.445253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-992fe0c9-c8de-4c34-83ef-4eb613686a15 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:06.446895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-992fe0c9-c8de-4c34-83ef-4eb613686a15 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:06.455752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-992fe0c9-c8de-4c34-83ef-4eb613686a15 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:06.456234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-992fe0c9-c8de-4c34-83ef-4eb613686a15 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:06.457006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-992fe0c9-c8de-4c34-83ef-4eb613686a15 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:06.457431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-992fe0c9-c8de-4c34-83ef-4eb613686a15 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:06.487237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-992fe0c9-c8de-4c34-83ef-4eb613686a15 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045847 Jul 20 13:55:06.487789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 482/949] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:06.978606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:06.979216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:06.986224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:06.986672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:06.987488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:06.987926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:07.129492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:07.137626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0c2c5dde-588c-4e18-bb2e-805462d4c2a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.162896 Jul 20 13:55:07.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 468/950] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:07.499041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c5efe4bd-dfb8-498b-842b-b4021a9d39d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:07.499934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c5efe4bd-dfb8-498b-842b-b4021a9d39d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:07.506411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5efe4bd-dfb8-498b-842b-b4021a9d39d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:07.506853 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5efe4bd-dfb8-498b-842b-b4021a9d39d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:07.507730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5efe4bd-dfb8-498b-842b-b4021a9d39d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:07.508161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5efe4bd-dfb8-498b-842b-b4021a9d39d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:07.537284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c5efe4bd-dfb8-498b-842b-b4021a9d39d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042240 Jul 20 13:55:07.537833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 483/951] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:08.154544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:08.155154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:08.161775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:08.162220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:08.162986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:08.164091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:08.291487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:08.298915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-de1b124a-a235-4ec1-934f-326a988f4cf6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148219 Jul 20 13:55:08.299468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 469/952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:08.549607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-046dda4f-622b-4bd3-95d0-831ff4422d64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:08.550457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-046dda4f-622b-4bd3-95d0-831ff4422d64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:08.556863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-046dda4f-622b-4bd3-95d0-831ff4422d64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:08.557304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-046dda4f-622b-4bd3-95d0-831ff4422d64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:08.558056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-046dda4f-622b-4bd3-95d0-831ff4422d64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:08.558487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-046dda4f-622b-4bd3-95d0-831ff4422d64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:08.588564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-046dda4f-622b-4bd3-95d0-831ff4422d64 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042906 Jul 20 13:55:08.589107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 484/953] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:09.320264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:09.320854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:09.323115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:09.328875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:09.329377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:09.330157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:09.330611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:09.463503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:09.471054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-98597524-6e4e-40bd-a64c-4d83b1049697 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154689 Jul 20 13:55:09.471617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 470/954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:09.599677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b6a4c89f-69e0-44d1-a263-cf467474365e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:09.600570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b6a4c89f-69e0-44d1-a263-cf467474365e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:09.607623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a4c89f-69e0-44d1-a263-cf467474365e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:09.608072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a4c89f-69e0-44d1-a263-cf467474365e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:09.608880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a4c89f-69e0-44d1-a263-cf467474365e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:09.609318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a4c89f-69e0-44d1-a263-cf467474365e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:09.639505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b6a4c89f-69e0-44d1-a263-cf467474365e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043786 Jul 20 13:55:09.640075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 485/955] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:10.487991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:10.488627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:10.494984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:10.495422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:10.496182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:10.496638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:10.625516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:10.632990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bb8decde-b462-4ea4-84d9-30d12bdb5011 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148849 Jul 20 13:55:10.633547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 471/956] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:10.652145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-691d92fb-67c0-4d85-bd1a-f5cdecec11e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:10.653751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-691d92fb-67c0-4d85-bd1a-f5cdecec11e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:10.660345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-691d92fb-67c0-4d85-bd1a-f5cdecec11e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:10.660797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-691d92fb-67c0-4d85-bd1a-f5cdecec11e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:10.661566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-691d92fb-67c0-4d85-bd1a-f5cdecec11e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:10.662002 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-691d92fb-67c0-4d85-bd1a-f5cdecec11e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:10.704494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-691d92fb-67c0-4d85-bd1a-f5cdecec11e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057417 Jul 20 13:55:10.705072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 486/957] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:11.650744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:11.651352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:11.657774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:11.658227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:11.658996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:11.659432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:11.717943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-75b35595-e77d-4f3a-aa2b-40f96e5bdb3d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:11.718863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-75b35595-e77d-4f3a-aa2b-40f96e5bdb3d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:11.725726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75b35595-e77d-4f3a-aa2b-40f96e5bdb3d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:11.726209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75b35595-e77d-4f3a-aa2b-40f96e5bdb3d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:11.726983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75b35595-e77d-4f3a-aa2b-40f96e5bdb3d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:11.727422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-75b35595-e77d-4f3a-aa2b-40f96e5bdb3d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:11.756455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-75b35595-e77d-4f3a-aa2b-40f96e5bdb3d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042828 Jul 20 13:55:11.757519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 487/958] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:11.799013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:11.806571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b4b0558e-c49e-4ee3-94a1-858143aa86f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.160155 Jul 20 13:55:11.807131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 472/959] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:12.768650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2ef2c9c5-30a0-4e99-971f-2977e124836d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:12.769494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2ef2c9c5-30a0-4e99-971f-2977e124836d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:12.771763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=58 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:12.777531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ef2c9c5-30a0-4e99-971f-2977e124836d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:12.777979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ef2c9c5-30a0-4e99-971f-2977e124836d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:12.778739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ef2c9c5-30a0-4e99-971f-2977e124836d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:12.779170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ef2c9c5-30a0-4e99-971f-2977e124836d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:12.807710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2ef2c9c5-30a0-4e99-971f-2977e124836d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043152 Jul 20 13:55:12.808274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 488/960] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:12.822879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:12.823757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:12.830514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:12.830962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:12.831780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:12.832237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:12.961389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:12.968885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a01b95fd-27ab-4dcd-a3ba-170c507d6fca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150023 Jul 20 13:55:12.969448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 473/961] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:13.819233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-664d7792-823f-4dcf-92c7-4cde033ae95f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:13.820685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-664d7792-823f-4dcf-92c7-4cde033ae95f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:13.827454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-664d7792-823f-4dcf-92c7-4cde033ae95f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:13.827899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-664d7792-823f-4dcf-92c7-4cde033ae95f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:13.828689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-664d7792-823f-4dcf-92c7-4cde033ae95f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:13.829123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-664d7792-823f-4dcf-92c7-4cde033ae95f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:13.858020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-664d7792-823f-4dcf-92c7-4cde033ae95f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042765 Jul 20 13:55:13.858565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 489/962] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:13.986673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:13.987284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:13.993750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:13.994201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:13.994968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:13.995404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:14.126472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:14.135399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bd79ba41-35ad-49dc-bfde-2dd87667ac20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152544 Jul 20 13:55:14.135966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 474/963] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:14.870224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-222ef9d5-67b8-4b0d-8240-86c218d27c76 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:14.871165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-222ef9d5-67b8-4b0d-8240-86c218d27c76 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:14.877592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-222ef9d5-67b8-4b0d-8240-86c218d27c76 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:14.878036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-222ef9d5-67b8-4b0d-8240-86c218d27c76 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:14.878802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-222ef9d5-67b8-4b0d-8240-86c218d27c76 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:14.879234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-222ef9d5-67b8-4b0d-8240-86c218d27c76 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:14.907723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-222ef9d5-67b8-4b0d-8240-86c218d27c76 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042147 Jul 20 13:55:14.908283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 490/964] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:15.152582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:15.153195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:15.159699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:15.160093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:15.160921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:15.161359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:15.288748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:15.296348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c7c9540d-a761-46ec-82ec-26032a8ebd02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147629 Jul 20 13:55:15.296932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 475/965] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:15.920870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4c3b2c22-db82-49a3-9d6c-ef24d257886c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:15.921791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4c3b2c22-db82-49a3-9d6c-ef24d257886c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:15.928293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c3b2c22-db82-49a3-9d6c-ef24d257886c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:15.928740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c3b2c22-db82-49a3-9d6c-ef24d257886c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:15.929507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c3b2c22-db82-49a3-9d6c-ef24d257886c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:15.929950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c3b2c22-db82-49a3-9d6c-ef24d257886c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:15.958956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4c3b2c22-db82-49a3-9d6c-ef24d257886c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042341 Jul 20 13:55:15.959531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 491/966] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:16.314052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:16.314638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:16.321035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:16.321484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:16.322252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:16.322693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:16.453010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:16.461322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-84c8887e-3ff4-4ec9-b199-3703849e0be2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151228 Jul 20 13:55:16.467404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 476/967] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:16.971050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d0b3ed04-4bdb-48b5-9f25-ed9ef673ac62 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:16.971953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d0b3ed04-4bdb-48b5-9f25-ed9ef673ac62 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:16.978396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0b3ed04-4bdb-48b5-9f25-ed9ef673ac62 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:16.978832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0b3ed04-4bdb-48b5-9f25-ed9ef673ac62 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:16.979584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0b3ed04-4bdb-48b5-9f25-ed9ef673ac62 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:16.980032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0b3ed04-4bdb-48b5-9f25-ed9ef673ac62 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:16.993305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:17.008581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d0b3ed04-4bdb-48b5-9f25-ed9ef673ac62 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041470 Jul 20 13:55:17.009120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 492/968] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:17.479205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:17.479810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:17.485846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:17.486294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:17.487053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:17.487486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:17.617690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:17.625169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-905b5165-419d-4fb8-94fd-6b7d2d1332ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150632 Jul 20 13:55:17.625724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 477/969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:18.020169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c8cc1bcb-4ff1-4974-be42-12db86bc778c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:18.021158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c8cc1bcb-4ff1-4974-be42-12db86bc778c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:18.027503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8cc1bcb-4ff1-4974-be42-12db86bc778c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:18.027949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8cc1bcb-4ff1-4974-be42-12db86bc778c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:18.028748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8cc1bcb-4ff1-4974-be42-12db86bc778c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:18.029175 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8cc1bcb-4ff1-4974-be42-12db86bc778c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:18.057361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c8cc1bcb-4ff1-4974-be42-12db86bc778c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041155 Jul 20 13:55:18.057894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 493/970] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:18.642467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:18.643073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:18.649604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:18.650084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:18.651038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:18.651479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:18.782336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:18.789703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f5ce6ac-57c0-435f-ab35-9606247a17ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151065 Jul 20 13:55:18.790262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 478/971] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:19.068816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a7bd253a-5fd3-449f-9989-65a385df7997 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:19.070165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a7bd253a-5fd3-449f-9989-65a385df7997 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:19.076771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7bd253a-5fd3-449f-9989-65a385df7997 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:19.077212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7bd253a-5fd3-449f-9989-65a385df7997 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:19.077966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7bd253a-5fd3-449f-9989-65a385df7997 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:19.078396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7bd253a-5fd3-449f-9989-65a385df7997 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:19.106905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a7bd253a-5fd3-449f-9989-65a385df7997 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042162 Jul 20 13:55:19.107449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 494/972] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:19.807352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:19.808035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:19.814458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:19.814913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:19.815681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:19.816118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:19.818623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:19.946986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:19.954726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a36734b5-72ac-489a-81c7-8b839de23411 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151870 Jul 20 13:55:19.955281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 479/973] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:20.118702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7e00f1c0-ba62-49d5-8c26-8cac8be5241c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:20.119616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7e00f1c0-ba62-49d5-8c26-8cac8be5241c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:20.126036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e00f1c0-ba62-49d5-8c26-8cac8be5241c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:20.126487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e00f1c0-ba62-49d5-8c26-8cac8be5241c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:20.127246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e00f1c0-ba62-49d5-8c26-8cac8be5241c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:20.127681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e00f1c0-ba62-49d5-8c26-8cac8be5241c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:20.156662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7e00f1c0-ba62-49d5-8c26-8cac8be5241c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042549 Jul 20 13:55:20.157140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 495/974] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:20.972261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:20.972867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:20.979948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:20.980440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:20.981202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:20.981637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:21.107673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:21.115414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-72e97ce0-e312-4e1a-bd6c-46675a41799c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147109 Jul 20 13:55:21.115986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 480/975] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:21.168713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-754222cd-00bc-4f6f-8d8e-ddce4d845239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:21.169666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-754222cd-00bc-4f6f-8d8e-ddce4d845239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:21.176042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-754222cd-00bc-4f6f-8d8e-ddce4d845239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:21.176520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-754222cd-00bc-4f6f-8d8e-ddce4d845239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:21.177270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-754222cd-00bc-4f6f-8d8e-ddce4d845239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:21.177696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-754222cd-00bc-4f6f-8d8e-ddce4d845239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:21.205575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-754222cd-00bc-4f6f-8d8e-ddce4d845239 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040836 Jul 20 13:55:21.206119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 496/976] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:22.132807 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:22.133447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:22.139722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:22.140169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:22.140975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:22.141407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:22.218065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e4d00189-1889-4741-a5f8-48507d994a12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:22.218539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e4d00189-1889-4741-a5f8-48507d994a12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:22.225746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4d00189-1889-4741-a5f8-48507d994a12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:22.226195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4d00189-1889-4741-a5f8-48507d994a12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:22.226969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4d00189-1889-4741-a5f8-48507d994a12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:22.227405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4d00189-1889-4741-a5f8-48507d994a12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:22.257091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e4d00189-1889-4741-a5f8-48507d994a12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043713 Jul 20 13:55:22.257655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 497/977] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:22.271834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:22.279248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a01ae01e-aaab-4e4d-b0ec-b289d55a34c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150427 Jul 20 13:55:22.279835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 481/978] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:23.268641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4c35661d-e358-4136-9c4c-fbd5aa83b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:23.269544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4c35661d-e358-4136-9c4c-fbd5aa83b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:23.275989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c35661d-e358-4136-9c4c-fbd5aa83b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:23.276461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c35661d-e358-4136-9c4c-fbd5aa83b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:23.277214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c35661d-e358-4136-9c4c-fbd5aa83b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:23.277642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c35661d-e358-4136-9c4c-fbd5aa83b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:23.296361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:23.296972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:23.303897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:23.304371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:23.305147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:23.305584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:23.306958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4c35661d-e358-4136-9c4c-fbd5aa83b5e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042288 Jul 20 13:55:23.307517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 498/979] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:23.443062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:23.451978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40cc4208-7520-4321-9308-223c13f328ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.159461 Jul 20 13:55:23.452606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 482/980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:55:24.317951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a328cd1a-e04e-4ded-a890-9414278340d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:24.319351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a328cd1a-e04e-4ded-a890-9414278340d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:24.325955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a328cd1a-e04e-4ded-a890-9414278340d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:24.326397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a328cd1a-e04e-4ded-a890-9414278340d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:24.327146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a328cd1a-e04e-4ded-a890-9414278340d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:24.327569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a328cd1a-e04e-4ded-a890-9414278340d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:24.355896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a328cd1a-e04e-4ded-a890-9414278340d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041930 Jul 20 13:55:24.356473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 499/981] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:24.468877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:24.469393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:24.475723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:24.476164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:24.476942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:24.477368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:24.605952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:24.613427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-73660520-0d77-4362-b864-6bcc035807f8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148411 Jul 20 13:55:24.613987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 483/982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:24 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:25.368098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f09a86fc-f903-4efe-85c0-e969e175635b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:25.369029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f09a86fc-f903-4efe-85c0-e969e175635b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:25.375415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f09a86fc-f903-4efe-85c0-e969e175635b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:25.375855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f09a86fc-f903-4efe-85c0-e969e175635b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:25.376641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f09a86fc-f903-4efe-85c0-e969e175635b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:25.377063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f09a86fc-f903-4efe-85c0-e969e175635b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:25.405159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f09a86fc-f903-4efe-85c0-e969e175635b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041693 Jul 20 13:55:25.405691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 500/983] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:25.630861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:25.632095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:25.638623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:25.639078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:25.639843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:25.640305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:25.771232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:25.779229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3ca86138-72d8-4107-8cc9-e99eb5ac579b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152310 Jul 20 13:55:25.779897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 484/984] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:26.416915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-49706d0e-7ef8-4c42-8da7-617d534c31aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:26.417904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-49706d0e-7ef8-4c42-8da7-617d534c31aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:26.424278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49706d0e-7ef8-4c42-8da7-617d534c31aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:26.424732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49706d0e-7ef8-4c42-8da7-617d534c31aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:26.425505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49706d0e-7ef8-4c42-8da7-617d534c31aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:26.425941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49706d0e-7ef8-4c42-8da7-617d534c31aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:26.460482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-49706d0e-7ef8-4c42-8da7-617d534c31aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048135 Jul 20 13:55:26.461040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 501/985] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:26.796173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:26.796804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:26.803779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:26.804242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:26.805178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:26.805648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:26.934097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:26.941502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-86762b46-3a57-428b-8561-fce07ad49180 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149167 Jul 20 13:55:26.942007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 485/986] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:27.472140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a19d55b6-c0c4-451d-9fcc-2699ee6cc2ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:27.473111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a19d55b6-c0c4-451d-9fcc-2699ee6cc2ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:27.480219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a19d55b6-c0c4-451d-9fcc-2699ee6cc2ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:27.480684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a19d55b6-c0c4-451d-9fcc-2699ee6cc2ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:27.481449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a19d55b6-c0c4-451d-9fcc-2699ee6cc2ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:27.481881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a19d55b6-c0c4-451d-9fcc-2699ee6cc2ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:27.514970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a19d55b6-c0c4-451d-9fcc-2699ee6cc2ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046833 Jul 20 13:55:27.515517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 502/987] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:27.958862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:27.959985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:27.966454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:27.966898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:27.967654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:27.968086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:28.099649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:28.109804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2182b154-555e-411a-9781-5441c6d059ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154728 Jul 20 13:55:28.110378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 486/988] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:28.527102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-59d2af7c-57e3-4d0f-8acb-f665bb595b18 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:28.528013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-59d2af7c-57e3-4d0f-8acb-f665bb595b18 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:28.534142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59d2af7c-57e3-4d0f-8acb-f665bb595b18 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:28.534585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59d2af7c-57e3-4d0f-8acb-f665bb595b18 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:28.535338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59d2af7c-57e3-4d0f-8acb-f665bb595b18 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:28.535767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-59d2af7c-57e3-4d0f-8acb-f665bb595b18 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:28.564653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-59d2af7c-57e3-4d0f-8acb-f665bb595b18 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041485 Jul 20 13:55:28.565203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 503/989] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:29.126827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:29.127436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:29.133893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:29.134337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:29.135098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:29.135529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:29.262847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:29.270572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4fb5797b-38f3-455e-ae2b-75ff27e7dca6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147649 Jul 20 13:55:29.271148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 487/990] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:29.576674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7de6b480-4acd-4c5a-9160-d4640a7f3852 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:29.577581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7de6b480-4acd-4c5a-9160-d4640a7f3852 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:29.584252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7de6b480-4acd-4c5a-9160-d4640a7f3852 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:29.585302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7de6b480-4acd-4c5a-9160-d4640a7f3852 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:29.586055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7de6b480-4acd-4c5a-9160-d4640a7f3852 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:29.586481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7de6b480-4acd-4c5a-9160-d4640a7f3852 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:29.614563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7de6b480-4acd-4c5a-9160-d4640a7f3852 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042188 Jul 20 13:55:29.615098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 504/991] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:30.288624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:30.289219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:30.295616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:30.296059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:30.296858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:30.297292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:30.425854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:30.433957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-76235b3b-f903-4e63-ab30-be8b473fe550 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149866 Jul 20 13:55:30.434520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 488/992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:30.626166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7895df75-c34d-4931-b15a-5a03f0245a31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:30.627075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7895df75-c34d-4931-b15a-5a03f0245a31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:30.633657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7895df75-c34d-4931-b15a-5a03f0245a31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:30.634093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7895df75-c34d-4931-b15a-5a03f0245a31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:30.634866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7895df75-c34d-4931-b15a-5a03f0245a31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:30.635301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7895df75-c34d-4931-b15a-5a03f0245a31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:30.664935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7895df75-c34d-4931-b15a-5a03f0245a31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042733 Jul 20 13:55:30.665486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 505/993] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:31.451150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:31.451766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:31.458921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:31.459900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:31.460699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:31.461133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:31.593925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:31.601973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c28c8714-fad1-408e-aab5-2071d1fa3c7a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154937 Jul 20 13:55:31.602541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 489/994] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:55:31.676849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-93329764-03c1-4eb4-b6e1-16c494e4fe35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:31.677756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-93329764-03c1-4eb4-b6e1-16c494e4fe35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:31.684084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93329764-03c1-4eb4-b6e1-16c494e4fe35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:31.684548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93329764-03c1-4eb4-b6e1-16c494e4fe35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:31.685297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93329764-03c1-4eb4-b6e1-16c494e4fe35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:31.685720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93329764-03c1-4eb4-b6e1-16c494e4fe35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:31.714010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-93329764-03c1-4eb4-b6e1-16c494e4fe35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041068 Jul 20 13:55:31.714511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 506/995] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:32.618826 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:32.619430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:32.625911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:32.626718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:32.627493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:32.627921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:32.725841 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6f3175e1-efce-4f79-a170-e772536747f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:32.726676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6f3175e1-efce-4f79-a170-e772536747f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:32.733700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6f3175e1-efce-4f79-a170-e772536747f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:32.734152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6f3175e1-efce-4f79-a170-e772536747f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:32.734969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6f3175e1-efce-4f79-a170-e772536747f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:32.735427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6f3175e1-efce-4f79-a170-e772536747f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:32.759226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:32.764533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6f3175e1-efce-4f79-a170-e772536747f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042932 Jul 20 13:55:32.765097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 507/996] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:32.766772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1b7602ef-0ca4-4dc2-9738-c182fd671bd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151782 Jul 20 13:55:32.767330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 490/997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:33.737168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:55:33.737750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 13:55:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:55:33.776452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2d05bd19-42b0-4041-a760-b8079c5fd3d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:33.777364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2d05bd19-42b0-4041-a760-b8079c5fd3d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:33.783789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d05bd19-42b0-4041-a760-b8079c5fd3d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:33.783963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:33.784260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d05bd19-42b0-4041-a760-b8079c5fd3d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:33.784580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:33.785028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d05bd19-42b0-4041-a760-b8079c5fd3d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:33.785461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d05bd19-42b0-4041-a760-b8079c5fd3d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:33.791704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:33.792149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:33.793077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:33.793513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:33.815217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2d05bd19-42b0-4041-a760-b8079c5fd3d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043222 Jul 20 13:55:33.815778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 508/998] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:33.927462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:33.934963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d1d68c8a-f559-4d32-bfe9-1306b86c4384 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154748 Jul 20 13:55:33.935518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 491/999] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:34.260097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:55:34.260278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 13:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:55:34.827151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e557876c-2f93-4b9e-98cb-406a3fab1ceb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:34.828058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e557876c-2f93-4b9e-98cb-406a3fab1ceb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:34.835162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e557876c-2f93-4b9e-98cb-406a3fab1ceb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:34.835599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e557876c-2f93-4b9e-98cb-406a3fab1ceb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:34.836384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e557876c-2f93-4b9e-98cb-406a3fab1ceb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:34.836809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e557876c-2f93-4b9e-98cb-406a3fab1ceb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:34.840306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:34.865256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e557876c-2f93-4b9e-98cb-406a3fab1ceb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042395 Jul 20 13:55:34.865796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 509/1000] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:34.951511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:34.952144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:34.958559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:34.959035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:34.960309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:34.960731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:35.089335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:35.096744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4246929f-b70c-4565-8738-016f49777cea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149297 Jul 20 13:55:35.097288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 492/1001] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:35.876882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3a0d20b1-2c2c-4a87-9a14-260b2d81cccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:35.877799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3a0d20b1-2c2c-4a87-9a14-260b2d81cccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:35.884402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a0d20b1-2c2c-4a87-9a14-260b2d81cccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:35.884851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a0d20b1-2c2c-4a87-9a14-260b2d81cccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:35.885664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a0d20b1-2c2c-4a87-9a14-260b2d81cccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:35.886051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a0d20b1-2c2c-4a87-9a14-260b2d81cccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:35.916375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3a0d20b1-2c2c-4a87-9a14-260b2d81cccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043490 Jul 20 13:55:35.916937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 510/1002] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:35.963411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:55:35.963563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 13:55:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:55:36.113627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:36.114250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:36.121158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:36.121608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:36.122378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:36.122817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:36.251407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:36.259639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-460d7bb1-3e68-44af-a051-c74ffedad5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149875 Jul 20 13:55:36.260201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 493/1003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:36.928041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e04ae5b0-1bb1-42c0-bce3-48236d8b6b70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:36.928977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e04ae5b0-1bb1-42c0-bce3-48236d8b6b70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:36.935719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ae5b0-1bb1-42c0-bce3-48236d8b6b70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:36.936161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ae5b0-1bb1-42c0-bce3-48236d8b6b70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:36.936952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ae5b0-1bb1-42c0-bce3-48236d8b6b70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:36.937384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ae5b0-1bb1-42c0-bce3-48236d8b6b70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:37.111409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e04ae5b0-1bb1-42c0-bce3-48236d8b6b70 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.187284 Jul 20 13:55:37.111950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 511/1004] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:37.277009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:37.277665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:37.284006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:37.284471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:37.285241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:37.285646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:37.415484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:37.422941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bd416128-d83f-482a-b6c1-f9f4a5e64ea7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149747 Jul 20 13:55:37.423508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 494/1005] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:38.123007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-85c5ff0a-5d45-4eda-907f-59430d32cd5b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:38.123925 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-85c5ff0a-5d45-4eda-907f-59430d32cd5b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:38.130506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85c5ff0a-5d45-4eda-907f-59430d32cd5b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:38.131628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85c5ff0a-5d45-4eda-907f-59430d32cd5b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:38.132348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85c5ff0a-5d45-4eda-907f-59430d32cd5b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:38.132786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85c5ff0a-5d45-4eda-907f-59430d32cd5b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:38.160314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-85c5ff0a-5d45-4eda-907f-59430d32cd5b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041227 Jul 20 13:55:38.160878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 512/1006] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:38.443335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:38.443956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:38.451061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:38.451510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:38.452305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:38.452744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:38.581744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:38.584527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:38.590904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-86c6e122-c074-455d-9ffa-7b938f82409e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151706 Jul 20 13:55:38.591469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 495/1007] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:39.171983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1a64b638-8fcb-4bbd-9115-a069a3e227c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:39.172920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1a64b638-8fcb-4bbd-9115-a069a3e227c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:39.180062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a64b638-8fcb-4bbd-9115-a069a3e227c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:39.180526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a64b638-8fcb-4bbd-9115-a069a3e227c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:39.181284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a64b638-8fcb-4bbd-9115-a069a3e227c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:39.181713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a64b638-8fcb-4bbd-9115-a069a3e227c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:39.211249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1a64b638-8fcb-4bbd-9115-a069a3e227c9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043189 Jul 20 13:55:39.211787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 513/1008] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:39.607667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:39.608236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:39.610618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:39.617096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:39.617609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:39.618417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:39.618855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:39.753467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:39.761024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9fdae592-2f53-48c3-bc94-18d085ec68bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.157299 Jul 20 13:55:39.761594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 496/1009] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:55:40.223879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7ba19945-e8ae-416f-80b0-f840fdc0b394 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:40.224860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7ba19945-e8ae-416f-80b0-f840fdc0b394 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:40.231479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ba19945-e8ae-416f-80b0-f840fdc0b394 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:40.231926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ba19945-e8ae-416f-80b0-f840fdc0b394 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:40.232724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ba19945-e8ae-416f-80b0-f840fdc0b394 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:40.233338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ba19945-e8ae-416f-80b0-f840fdc0b394 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:40.264385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7ba19945-e8ae-416f-80b0-f840fdc0b394 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044602 Jul 20 13:55:40.265024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 514/1010] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:40.777996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:40.778600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:40.785076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:40.786722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:40.787368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:40.787753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:40.915327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:40.922745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0c0efde1-2cb8-4add-ada8-44b87dff6938 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148685 Jul 20 13:55:40.923308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 497/1011] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:41.275953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b48bf94f-f07f-456b-8e6d-b5dfa57a0b37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:41.276824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b48bf94f-f07f-456b-8e6d-b5dfa57a0b37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:41.283209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b48bf94f-f07f-456b-8e6d-b5dfa57a0b37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:41.283662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b48bf94f-f07f-456b-8e6d-b5dfa57a0b37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:41.284456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b48bf94f-f07f-456b-8e6d-b5dfa57a0b37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:41.284892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b48bf94f-f07f-456b-8e6d-b5dfa57a0b37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:41.313312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b48bf94f-f07f-456b-8e6d-b5dfa57a0b37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042187 Jul 20 13:55:41.313847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 515/1012] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:41.940546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:41.941174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:41.948506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:41.948946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:41.949697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:41.950122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:42.082363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:42.090035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-92ba5567-80d1-4644-ac0b-15de250b3bac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153478 Jul 20 13:55:42.090603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 498/1013] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:42.325443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a285ad20-450a-47c7-87e1-6dde86ed3e02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:42.326270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a285ad20-450a-47c7-87e1-6dde86ed3e02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:42.332703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a285ad20-450a-47c7-87e1-6dde86ed3e02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:42.333151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a285ad20-450a-47c7-87e1-6dde86ed3e02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:42.333919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a285ad20-450a-47c7-87e1-6dde86ed3e02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:42.334353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a285ad20-450a-47c7-87e1-6dde86ed3e02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:42.362730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a285ad20-450a-47c7-87e1-6dde86ed3e02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041667 Jul 20 13:55:42.363259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 516/1014] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:43.106711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:43.107315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:43.113783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:43.114228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:43.115622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:43.116053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:43.248457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:43.255903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2d09256f-72fc-48d3-84d7-a339673f3406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153129 Jul 20 13:55:43.256494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 499/1015] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:43.374905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b8ec1b3d-4f70-4bc0-a8d2-5a3582691ce0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:43.375765 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b8ec1b3d-4f70-4bc0-a8d2-5a3582691ce0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:43.378169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=58 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:43.383583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8ec1b3d-4f70-4bc0-a8d2-5a3582691ce0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:43.384025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8ec1b3d-4f70-4bc0-a8d2-5a3582691ce0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:43.384818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8ec1b3d-4f70-4bc0-a8d2-5a3582691ce0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:43.385244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8ec1b3d-4f70-4bc0-a8d2-5a3582691ce0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:43.415592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b8ec1b3d-4f70-4bc0-a8d2-5a3582691ce0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Jul 20 13:55:43.416136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 517/1016] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:44.273517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:44.274117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:44.280657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:44.281104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:44.281860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:44.282285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:44.410026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:44.418026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-80da52ff-3d86-4409-b42b-7b9489bd4375 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148872 Jul 20 13:55:44.418594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 500/1017] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:44.426951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dfc9dbbb-2944-4d23-87bb-4e9b2e6b4a5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:44.427925 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dfc9dbbb-2944-4d23-87bb-4e9b2e6b4a5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:44.434340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfc9dbbb-2944-4d23-87bb-4e9b2e6b4a5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:44.434785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfc9dbbb-2944-4d23-87bb-4e9b2e6b4a5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:44.435546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfc9dbbb-2944-4d23-87bb-4e9b2e6b4a5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:44.435975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfc9dbbb-2944-4d23-87bb-4e9b2e6b4a5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:44.464829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dfc9dbbb-2944-4d23-87bb-4e9b2e6b4a5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041864 Jul 20 13:55:44.465380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 518/1018] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:45.435221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:45.435823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:45.442511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:45.442956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:45.443715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:45.444145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:45.476988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f31773a1-d30f-4261-9960-9f34b6af0870 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:45.477993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f31773a1-d30f-4261-9960-9f34b6af0870 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:45.484659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f31773a1-d30f-4261-9960-9f34b6af0870 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:45.485187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f31773a1-d30f-4261-9960-9f34b6af0870 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:45.486038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f31773a1-d30f-4261-9960-9f34b6af0870 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:45.486475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f31773a1-d30f-4261-9960-9f34b6af0870 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:45.515652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f31773a1-d30f-4261-9960-9f34b6af0870 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043161 Jul 20 13:55:45.516217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 519/1019] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:45.577842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:45.585325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3735ac19-45a9-4069-b6ba-d90a5a7fce0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153978 Jul 20 13:55:45.585884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 501/1020] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:46.527032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e341ded2-cbcf-41f6-9bc8-0cca461b1f35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:46.527869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e341ded2-cbcf-41f6-9bc8-0cca461b1f35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:46.534419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e341ded2-cbcf-41f6-9bc8-0cca461b1f35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:46.534876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e341ded2-cbcf-41f6-9bc8-0cca461b1f35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:46.535644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e341ded2-cbcf-41f6-9bc8-0cca461b1f35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:46.536082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e341ded2-cbcf-41f6-9bc8-0cca461b1f35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:46.564780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e341ded2-cbcf-41f6-9bc8-0cca461b1f35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041836 Jul 20 13:55:46.565327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 520/1021] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:46.603135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:46.603745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:46.610351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:46.610936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:46.611731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:46.612162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:46.746891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:46.754369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aa7f4322-cdc7-446f-8bea-f2e8b01f61a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155729 Jul 20 13:55:46.754930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 502/1022] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:47.576869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1a6481d-ea4f-417f-88e7-17deeb1c24e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:47.577786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d1a6481d-ea4f-417f-88e7-17deeb1c24e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:47.585206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a6481d-ea4f-417f-88e7-17deeb1c24e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:47.585659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a6481d-ea4f-417f-88e7-17deeb1c24e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:47.586431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a6481d-ea4f-417f-88e7-17deeb1c24e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:47.586873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a6481d-ea4f-417f-88e7-17deeb1c24e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:47.615977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d1a6481d-ea4f-417f-88e7-17deeb1c24e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043449 Jul 20 13:55:47.616557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 521/1023] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:47.772747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:47.773386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:47.779363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:47.779811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:47.780600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:47.781036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:47.912257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:47.919822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c0135c0d-0abb-4dfe-ad5f-34d732d3c09e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151809 Jul 20 13:55:47.920482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 503/1024] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:48.627557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-299c2072-10dc-41bf-a64d-1d37f18e219a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:48.628485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-299c2072-10dc-41bf-a64d-1d37f18e219a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:48.635858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-299c2072-10dc-41bf-a64d-1d37f18e219a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:48.636148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-299c2072-10dc-41bf-a64d-1d37f18e219a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:48.636959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-299c2072-10dc-41bf-a64d-1d37f18e219a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:48.637411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-299c2072-10dc-41bf-a64d-1d37f18e219a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:48.665986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-299c2072-10dc-41bf-a64d-1d37f18e219a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042431 Jul 20 13:55:48.666528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 522/1025] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:48.936477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:48.937125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:48.943626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:48.944075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:48.944874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:48.945316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:49.072768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:49.080405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-efd8af8d-e929-4e55-95f4-d4be498b9010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147810 Jul 20 13:55:49.080967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 504/1026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:49.678217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5553eddb-27f8-42cf-ab5b-c8e41b14e159 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:49.679132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5553eddb-27f8-42cf-ab5b-c8e41b14e159 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:49.685806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5553eddb-27f8-42cf-ab5b-c8e41b14e159 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:49.686257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5553eddb-27f8-42cf-ab5b-c8e41b14e159 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:49.687015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5553eddb-27f8-42cf-ab5b-c8e41b14e159 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:49.687448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5553eddb-27f8-42cf-ab5b-c8e41b14e159 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:49.716145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5553eddb-27f8-42cf-ab5b-c8e41b14e159 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042382 Jul 20 13:55:49.716697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 523/1027] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:50.097343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:50.097975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:50.105081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:50.105532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:50.106296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:50.106734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:50.236913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:50.244328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0294c4b7-e4b7-4f70-9a89-630f96c5cb8c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150952 Jul 20 13:55:50.244896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 505/1028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:50.727249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-801d1d05-f3de-4bf4-b215-8fcb7e25655a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:50.728155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-801d1d05-f3de-4bf4-b215-8fcb7e25655a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:50.734649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-801d1d05-f3de-4bf4-b215-8fcb7e25655a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:50.735100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-801d1d05-f3de-4bf4-b215-8fcb7e25655a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:50.735868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-801d1d05-f3de-4bf4-b215-8fcb7e25655a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:50.736337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-801d1d05-f3de-4bf4-b215-8fcb7e25655a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:50.765054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-801d1d05-f3de-4bf4-b215-8fcb7e25655a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041837 Jul 20 13:55:50.765648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 524/1029] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:51.261775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:51.262419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:51.268860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:51.269312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:51.270078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:51.270514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:51.401293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:51.408798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c1fd3daf-576b-489a-aa6c-58b798e4e60c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151008 Jul 20 13:55:51.409367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 506/1030] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:51.776901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ea608fe4-e782-456a-a3ce-40bceb9d055b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:51.777815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ea608fe4-e782-456a-a3ce-40bceb9d055b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:51.784260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea608fe4-e782-456a-a3ce-40bceb9d055b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:51.784715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea608fe4-e782-456a-a3ce-40bceb9d055b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:51.785480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea608fe4-e782-456a-a3ce-40bceb9d055b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:51.785917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea608fe4-e782-456a-a3ce-40bceb9d055b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:51.810228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:51.815106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ea608fe4-e782-456a-a3ce-40bceb9d055b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042204 Jul 20 13:55:51.815655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 525/1031] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:52.425829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:52.426473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:52.433018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:52.433408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:52.434165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:52.434594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:52.562267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:52.569740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2ab5298f-d8c3-45ea-8f5d-11ad9bcdbddb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147846 Jul 20 13:55:52.570307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 507/1032] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:52.827641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff76b706-b2e5-46c0-b669-eb81c560d9ab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:52.828502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff76b706-b2e5-46c0-b669-eb81c560d9ab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:52.835522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff76b706-b2e5-46c0-b669-eb81c560d9ab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:52.836066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff76b706-b2e5-46c0-b669-eb81c560d9ab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:52.836860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff76b706-b2e5-46c0-b669-eb81c560d9ab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:52.837290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff76b706-b2e5-46c0-b669-eb81c560d9ab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:52.865068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff76b706-b2e5-46c0-b669-eb81c560d9ab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042001 Jul 20 13:55:52.865605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 526/1033] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:53.587757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:53.588430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:53.594764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:53.595209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:53.595969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:53.596436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:53.726635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:53.734129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d6b88142-4098-4de1-a08b-26e133e6bc70 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150950 Jul 20 13:55:53.734692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 508/1034] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:53.825486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:55:53.825641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 13:55:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:55:53.877071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4510160d-6141-4c9b-bb01-09c2ddd525ce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:53.877953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4510160d-6141-4c9b-bb01-09c2ddd525ce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:53.885184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4510160d-6141-4c9b-bb01-09c2ddd525ce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:53.885636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4510160d-6141-4c9b-bb01-09c2ddd525ce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:53.886408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4510160d-6141-4c9b-bb01-09c2ddd525ce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:53.886847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4510160d-6141-4c9b-bb01-09c2ddd525ce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:53.914745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4510160d-6141-4c9b-bb01-09c2ddd525ce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041656 Jul 20 13:55:53.915279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 527/1035] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:54.750751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:54.751339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:54.758069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:54.758518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:54.759280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:54.759713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:54.888557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:54.896421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-37f97864-1074-4837-a301-a7fb25e633ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148968 Jul 20 13:55:54.896977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 509/1036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:54.925769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e8c22d85-36ea-4ab7-89ff-a7c58b4368f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:54.926698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e8c22d85-36ea-4ab7-89ff-a7c58b4368f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:54.933504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e8c22d85-36ea-4ab7-89ff-a7c58b4368f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:54.933952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e8c22d85-36ea-4ab7-89ff-a7c58b4368f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:54.934729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e8c22d85-36ea-4ab7-89ff-a7c58b4368f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:54.935162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e8c22d85-36ea-4ab7-89ff-a7c58b4368f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:54.965019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e8c22d85-36ea-4ab7-89ff-a7c58b4368f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043163 Jul 20 13:55:54.965561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 528/1037] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:55.914993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:55.915590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:55.922244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:55.922685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:55.923438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:55.923860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:55.977323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1751d9d0-435b-42b2-b808-7124f81ec051 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:55.978368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1751d9d0-435b-42b2-b808-7124f81ec051 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:55.984847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1751d9d0-435b-42b2-b808-7124f81ec051 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:55.985290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1751d9d0-435b-42b2-b808-7124f81ec051 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:55.986061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1751d9d0-435b-42b2-b808-7124f81ec051 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:55.986977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1751d9d0-435b-42b2-b808-7124f81ec051 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:56.017071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1751d9d0-435b-42b2-b808-7124f81ec051 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044388 Jul 20 13:55:56.017645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 529/1038] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:55:56.057951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:56.065296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5fa6dd97-baa4-4bb8-99ca-eb5558a12e62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154238 Jul 20 13:55:56.065846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 510/1039] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:55:57.028882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ed15a463-e570-42e3-8326-6473c5629fe5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:57.029823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ed15a463-e570-42e3-8326-6473c5629fe5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:57.036249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed15a463-e570-42e3-8326-6473c5629fe5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:57.037358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed15a463-e570-42e3-8326-6473c5629fe5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:57.038165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed15a463-e570-42e3-8326-6473c5629fe5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:57.038606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed15a463-e570-42e3-8326-6473c5629fe5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:57.066536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ed15a463-e570-42e3-8326-6473c5629fe5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041694 Jul 20 13:55:57.067069 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 530/1040] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:57.082337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:57.082942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:57.089813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:57.090259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:57.091010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:57.091436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:57.219197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:57.227155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f9db72f7-4ba9-40cc-8c8a-e954b244900e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148696 Jul 20 13:55:57.227708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 511/1041] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:58.078769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f3f251ee-2eda-412c-b6c0-f8f129c070a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:58.079727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f3f251ee-2eda-412c-b6c0-f8f129c070a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:58.086353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3f251ee-2eda-412c-b6c0-f8f129c070a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:58.086794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3f251ee-2eda-412c-b6c0-f8f129c070a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:58.087549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3f251ee-2eda-412c-b6c0-f8f129c070a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:58.087976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3f251ee-2eda-412c-b6c0-f8f129c070a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:58.115430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f3f251ee-2eda-412c-b6c0-f8f129c070a7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040778 Jul 20 13:55:58.115956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 531/1042] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:58.244025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:58.244648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:58.251029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:58.251469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:58.252267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:58.252692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:58.267563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:58.382951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:58.390474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dcac18fb-b158-49c0-9d24-faaa06a80856 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150348 Jul 20 13:55:58.391036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 512/1043] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:55:59.127123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f76938fe-26aa-4d35-a2e0-786d55b0fbd9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:59.128028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f76938fe-26aa-4d35-a2e0-786d55b0fbd9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:59.134442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76938fe-26aa-4d35-a2e0-786d55b0fbd9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:59.134878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76938fe-26aa-4d35-a2e0-786d55b0fbd9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:59.135628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76938fe-26aa-4d35-a2e0-786d55b0fbd9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:59.136055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f76938fe-26aa-4d35-a2e0-786d55b0fbd9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:59.165057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f76938fe-26aa-4d35-a2e0-786d55b0fbd9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041913 Jul 20 13:55:59.165588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 532/1044] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:55:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:55:59.407410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:55:59.408016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:55:59.415322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:59.415770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:59.416561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:55:59.416995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:55:59.550488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:55:59.557842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a5d20d90-264e-45f2-be1e-be4ac39e59c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154307 Jul 20 13:55:59.558392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 513/1045] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:55:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:00.177422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-69185b15-7ba8-425e-9940-48f2a655fd47 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:00.178337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-69185b15-7ba8-425e-9940-48f2a655fd47 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:00.185169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69185b15-7ba8-425e-9940-48f2a655fd47 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:00.185617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69185b15-7ba8-425e-9940-48f2a655fd47 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:00.186434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69185b15-7ba8-425e-9940-48f2a655fd47 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:00.186866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69185b15-7ba8-425e-9940-48f2a655fd47 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:00.215777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-69185b15-7ba8-425e-9940-48f2a655fd47 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042951 Jul 20 13:56:00.216336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 533/1046] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:00.574403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:00.574922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:00.581455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:00.581888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:00.582657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:00.583093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:00.719428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:00.733265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fc68c7ef-a66a-41b5-ac75-6c68a130d910 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.162989 Jul 20 13:56:00.734111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 514/1047] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:01.228131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3c66c7ba-b00a-424b-a41b-b9424718a093 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:01.229055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3c66c7ba-b00a-424b-a41b-b9424718a093 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:01.235683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3c66c7ba-b00a-424b-a41b-b9424718a093 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:01.236122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3c66c7ba-b00a-424b-a41b-b9424718a093 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:01.236903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3c66c7ba-b00a-424b-a41b-b9424718a093 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:01.237328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3c66c7ba-b00a-424b-a41b-b9424718a093 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:01.266308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3c66c7ba-b00a-424b-a41b-b9424718a093 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042716 Jul 20 13:56:01.266850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 534/1048] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:01.751401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:01.752002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:01.758979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:01.759421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:01.760168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:01.760623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:01.894202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:01.902202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6768e865-f167-4ce4-abf3-369c1fde845e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154646 Jul 20 13:56:01.902754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 515/1049] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:02.277201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-769fe33c-e792-4d93-8135-13f6bdd0f123 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:02.278108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-769fe33c-e792-4d93-8135-13f6bdd0f123 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:02.284529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-769fe33c-e792-4d93-8135-13f6bdd0f123 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:02.284969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-769fe33c-e792-4d93-8135-13f6bdd0f123 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:02.285718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-769fe33c-e792-4d93-8135-13f6bdd0f123 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:02.286146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-769fe33c-e792-4d93-8135-13f6bdd0f123 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:02.314822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-769fe33c-e792-4d93-8135-13f6bdd0f123 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041543 Jul 20 13:56:02.315360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 535/1050] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:02.918846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:02.919453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:02.925923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:02.926362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:02.927212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:02.927645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:03.055158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:03.062468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4b67f157-9202-4113-aaac-804678d9c72b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147493 Jul 20 13:56:03.063022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 516/1051] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:03.327318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2a8a94cc-3675-4b53-ab03-8da1e8627db6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:03.328155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2a8a94cc-3675-4b53-ab03-8da1e8627db6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:03.335156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a8a94cc-3675-4b53-ab03-8da1e8627db6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:03.335604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a8a94cc-3675-4b53-ab03-8da1e8627db6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:03.336413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a8a94cc-3675-4b53-ab03-8da1e8627db6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:03.336849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a8a94cc-3675-4b53-ab03-8da1e8627db6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:03.364629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2a8a94cc-3675-4b53-ab03-8da1e8627db6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041619 Jul 20 13:56:03.365161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 536/1052] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:04.079671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:04.080454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:04.087442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:04.087903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:04.088681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:04.089108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:04.222642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:04.233145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40df16c4-4ab4-43ed-b528-36bbf08b79e7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.157160 Jul 20 13:56:04.233877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 517/1053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:04.377316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2b2c948a-1b79-4e38-8213-e024daf125be tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:04.378242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2b2c948a-1b79-4e38-8213-e024daf125be tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:04.386223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b2c948a-1b79-4e38-8213-e024daf125be tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:04.386772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b2c948a-1b79-4e38-8213-e024daf125be tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:04.387686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b2c948a-1b79-4e38-8213-e024daf125be tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:04.388172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b2c948a-1b79-4e38-8213-e024daf125be tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:04.420260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2b2c948a-1b79-4e38-8213-e024daf125be tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047718 Jul 20 13:56:04.420849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 537/1054] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:05.250811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:05.251353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:05.257891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:05.258343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:05.259093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:05.259524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:05.397905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:05.405343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5cb0f196-f65e-415e-b1f2-679db1ada3ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.158497 Jul 20 13:56:05.405916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 518/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:05.430985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6c2e252e-c9cb-4470-9b22-bc327dedfe51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:05.431901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6c2e252e-c9cb-4470-9b22-bc327dedfe51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:05.438239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6c2e252e-c9cb-4470-9b22-bc327dedfe51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:05.438679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6c2e252e-c9cb-4470-9b22-bc327dedfe51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:05.439431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6c2e252e-c9cb-4470-9b22-bc327dedfe51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:05.439861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6c2e252e-c9cb-4470-9b22-bc327dedfe51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:05.468182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6c2e252e-c9cb-4470-9b22-bc327dedfe51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041133 Jul 20 13:56:05.468734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 538/1056] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:06.423118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:06.423725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:06.430424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:06.430872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:06.431760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:06.432249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:06.479038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-da05a7ef-bad6-479d-a4ed-c6307c318f3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:06.479877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-da05a7ef-bad6-479d-a4ed-c6307c318f3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:06.486198 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da05a7ef-bad6-479d-a4ed-c6307c318f3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:06.486647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da05a7ef-bad6-479d-a4ed-c6307c318f3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:06.487419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da05a7ef-bad6-479d-a4ed-c6307c318f3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:06.487855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da05a7ef-bad6-479d-a4ed-c6307c318f3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:06.518302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-da05a7ef-bad6-479d-a4ed-c6307c318f3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043220 Jul 20 13:56:06.518980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 539/1057] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:06.564570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:06.572877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2b3cee09-587e-407e-96ac-21d287641ed9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153323 Jul 20 13:56:06.573440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 519/1058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:07.529193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0910c302-94fd-4197-8604-407b4af6431c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:07.530139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0910c302-94fd-4197-8604-407b4af6431c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:07.537287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0910c302-94fd-4197-8604-407b4af6431c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:07.537738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0910c302-94fd-4197-8604-407b4af6431c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:07.538510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0910c302-94fd-4197-8604-407b4af6431c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:07.538949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0910c302-94fd-4197-8604-407b4af6431c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:07.567109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0910c302-94fd-4197-8604-407b4af6431c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041919 Jul 20 13:56:07.567690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 540/1059] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:07.590330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:07.590958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:07.597755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:07.598273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:07.599792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:07.600313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:07.737634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:07.745392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-25dd6150-2535-4d30-9611-a5ac06bd4905 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.159062 Jul 20 13:56:07.745956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 520/1060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:08.579419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-de9fcb46-fabf-4ab0-9b7b-43676cd2a728 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:08.580264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-de9fcb46-fabf-4ab0-9b7b-43676cd2a728 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:08.587375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de9fcb46-fabf-4ab0-9b7b-43676cd2a728 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:08.587812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de9fcb46-fabf-4ab0-9b7b-43676cd2a728 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:08.588593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de9fcb46-fabf-4ab0-9b7b-43676cd2a728 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:08.589018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de9fcb46-fabf-4ab0-9b7b-43676cd2a728 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:08.617215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-de9fcb46-fabf-4ab0-9b7b-43676cd2a728 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041838 Jul 20 13:56:08.617752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 541/1061] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:08.763239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:08.763828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:08.770527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:08.771543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:08.772343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:08.772772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:08.909463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:08.916938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c9ad6385-5023-4942-9105-6d7f2fc690df tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.157613 Jul 20 13:56:08.917493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 521/1062] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:09.628961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9382d9f0-5f40-46f6-b388-effa74db9a79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:09.629792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9382d9f0-5f40-46f6-b388-effa74db9a79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:09.636437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9382d9f0-5f40-46f6-b388-effa74db9a79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:09.636890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9382d9f0-5f40-46f6-b388-effa74db9a79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:09.637666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9382d9f0-5f40-46f6-b388-effa74db9a79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:09.638135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9382d9f0-5f40-46f6-b388-effa74db9a79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:09.652416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:09.668516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9382d9f0-5f40-46f6-b388-effa74db9a79 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043618 Jul 20 13:56:09.669076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 542/1063] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:09.933878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:09.934483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:09.936829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:09.942126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:09.942570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:09.943327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:09.943757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:10.080534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:10.088781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4049cd78-87ea-42cf-a119-1c48d367698b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.158860 Jul 20 13:56:10.089645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 522/1064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:10.680721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-37448219-40ea-4e9d-83ca-934bb0715302 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:10.681640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-37448219-40ea-4e9d-83ca-934bb0715302 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:10.688062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37448219-40ea-4e9d-83ca-934bb0715302 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:10.688546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37448219-40ea-4e9d-83ca-934bb0715302 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:10.689318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37448219-40ea-4e9d-83ca-934bb0715302 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:10.689754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37448219-40ea-4e9d-83ca-934bb0715302 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:10.718982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-37448219-40ea-4e9d-83ca-934bb0715302 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042775 Jul 20 13:56:10.719581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 543/1065] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:11.106212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:11.106855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:11.113311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:11.113785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:11.115036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:11.115466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:11.249426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:11.257483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f387dec8-2a6f-4ae4-984b-6b30080ab447 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155144 Jul 20 13:56:11.258037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 523/1066] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:11.730351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-87b26820-786e-418a-843e-7b1cf01c90cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:11.731263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-87b26820-786e-418a-843e-7b1cf01c90cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:11.737633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87b26820-786e-418a-843e-7b1cf01c90cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:11.738078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87b26820-786e-418a-843e-7b1cf01c90cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:11.738843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87b26820-786e-418a-843e-7b1cf01c90cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:11.739300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87b26820-786e-418a-843e-7b1cf01c90cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:11.767437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-87b26820-786e-418a-843e-7b1cf01c90cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041141 Jul 20 13:56:11.767971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 544/1067] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:12.275093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:12.275858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:12.282338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:12.282789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:12.283561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:12.283996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:12.414011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:12.421513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0bd8394a-83c3-488a-a172-4ee6b3358a87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151038 Jul 20 13:56:12.422077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 524/1068] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:12.779118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5e15ce5a-53a5-40e9-a51f-5829a3121786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:12.780031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5e15ce5a-53a5-40e9-a51f-5829a3121786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:12.786999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e15ce5a-53a5-40e9-a51f-5829a3121786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:12.787440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e15ce5a-53a5-40e9-a51f-5829a3121786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:12.788215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e15ce5a-53a5-40e9-a51f-5829a3121786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:12.788657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e15ce5a-53a5-40e9-a51f-5829a3121786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:12.817439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5e15ce5a-53a5-40e9-a51f-5829a3121786 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042274 Jul 20 13:56:12.818022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 545/1069] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:13.439467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:13.440075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:13.447183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:13.447905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:13.448696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:13.449136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:13.581988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:13.589507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-be5e0ad7-9180-4a94-893e-d835e56e1880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153912 Jul 20 13:56:13.590070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 525/1070] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:13.829889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-43cdd69f-07ba-4853-9d8c-adf5b1dacfa5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:13.830763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-43cdd69f-07ba-4853-9d8c-adf5b1dacfa5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:13.833370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=58 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:13.838850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43cdd69f-07ba-4853-9d8c-adf5b1dacfa5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:13.839288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43cdd69f-07ba-4853-9d8c-adf5b1dacfa5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:13.840044 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43cdd69f-07ba-4853-9d8c-adf5b1dacfa5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:13.840572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-43cdd69f-07ba-4853-9d8c-adf5b1dacfa5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:13.870005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-43cdd69f-07ba-4853-9d8c-adf5b1dacfa5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044369 Jul 20 13:56:13.870588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 546/1071] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:14.606580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:14.607115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:14.613530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:14.613977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:14.615098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:14.615536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:14.745301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:14.752857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e9cf8dd6-c71b-4b80-9092-90f0b2e70d76 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150236 Jul 20 13:56:14.753422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 526/1072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:14.881745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4bd82309-6a3b-4e8b-be66-72c6fc896fd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:14.882571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4bd82309-6a3b-4e8b-be66-72c6fc896fd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:14.889189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bd82309-6a3b-4e8b-be66-72c6fc896fd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:14.889635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bd82309-6a3b-4e8b-be66-72c6fc896fd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:14.890399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bd82309-6a3b-4e8b-be66-72c6fc896fd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:14.890832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bd82309-6a3b-4e8b-be66-72c6fc896fd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:14.919693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4bd82309-6a3b-4e8b-be66-72c6fc896fd7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042035 Jul 20 13:56:14.920248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 547/1073] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:15.770286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:15.770896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:15.777462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:15.777907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:15.778700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:15.779132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:15.912519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:15.920130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c1939576-041c-44cd-b6db-3670c1690639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153760 Jul 20 13:56:15.920726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 527/1074] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:15.931146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6ba25118-8c8d-4fe5-b8eb-0d4caea30f29 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:15.932056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6ba25118-8c8d-4fe5-b8eb-0d4caea30f29 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:15.938527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ba25118-8c8d-4fe5-b8eb-0d4caea30f29 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:15.938975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ba25118-8c8d-4fe5-b8eb-0d4caea30f29 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:15.939732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ba25118-8c8d-4fe5-b8eb-0d4caea30f29 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:15.940166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ba25118-8c8d-4fe5-b8eb-0d4caea30f29 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:15.969312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6ba25118-8c8d-4fe5-b8eb-0d4caea30f29 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042302 Jul 20 13:56:15.969848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 548/1075] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:16.937290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:16.937912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:16.944866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:16.945319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:16.946088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:16.946526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:16.981135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dccbaa11-c3f1-4e65-9882-9c99eafba0e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:16.982096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dccbaa11-c3f1-4e65-9882-9c99eafba0e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:16.988852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dccbaa11-c3f1-4e65-9882-9c99eafba0e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:16.989297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dccbaa11-c3f1-4e65-9882-9c99eafba0e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:16.990063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dccbaa11-c3f1-4e65-9882-9c99eafba0e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:16.990491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dccbaa11-c3f1-4e65-9882-9c99eafba0e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:17.020444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dccbaa11-c3f1-4e65-9882-9c99eafba0e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043367 Jul 20 13:56:17.021587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 549/1076] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:17.079055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:17.087352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2d0fd927-6b5d-48eb-af1c-4c4c7bba0548 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153969 Jul 20 13:56:17.087917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 528/1077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:56:18.032748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fdd934b8-4f7c-4195-b7a5-e6e82a248219 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:18.033668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fdd934b8-4f7c-4195-b7a5-e6e82a248219 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:18.040860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdd934b8-4f7c-4195-b7a5-e6e82a248219 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:18.041307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdd934b8-4f7c-4195-b7a5-e6e82a248219 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:18.042072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdd934b8-4f7c-4195-b7a5-e6e82a248219 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:18.042506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdd934b8-4f7c-4195-b7a5-e6e82a248219 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:18.070578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fdd934b8-4f7c-4195-b7a5-e6e82a248219 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041920 Jul 20 13:56:18.071119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 550/1078] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:18.104897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:18.105504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:18.111923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:18.112439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:18.113206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:18.113661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:18.116804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:18.242189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:18.249643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1c16e03b-0de8-4f3c-8a2b-81f608cb5a14 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148568 Jul 20 13:56:18.250204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 529/1079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:19.082643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5b005056-d9cb-4611-b9b3-3fdf8800e03a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:19.084128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5b005056-d9cb-4611-b9b3-3fdf8800e03a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:19.091740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b005056-d9cb-4611-b9b3-3fdf8800e03a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:19.092210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b005056-d9cb-4611-b9b3-3fdf8800e03a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:19.092990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b005056-d9cb-4611-b9b3-3fdf8800e03a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:19.093436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b005056-d9cb-4611-b9b3-3fdf8800e03a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:19.121342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5b005056-d9cb-4611-b9b3-3fdf8800e03a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042745 Jul 20 13:56:19.121911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 551/1080] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:19.266776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:19.267379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:19.273843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:19.274294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:19.275053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:19.275487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:19.410006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:19.418048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-307cfc5e-ed82-4b41-9316-ba645b3b7406 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155175 Jul 20 13:56:19.418624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 530/1081] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:20.133324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-05c17788-9ede-444b-b5a5-1a7aa6c30d31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:20.134316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-05c17788-9ede-444b-b5a5-1a7aa6c30d31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:20.140879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05c17788-9ede-444b-b5a5-1a7aa6c30d31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:20.141331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05c17788-9ede-444b-b5a5-1a7aa6c30d31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:20.142099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05c17788-9ede-444b-b5a5-1a7aa6c30d31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:20.142538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05c17788-9ede-444b-b5a5-1a7aa6c30d31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:20.171777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-05c17788-9ede-444b-b5a5-1a7aa6c30d31 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042618 Jul 20 13:56:20.172351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 552/1082] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:20.434988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:20.435601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:20.442105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:20.443104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:20.443868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:20.444337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:20.583996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:20.591512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b0a2e9d1-906f-403e-a823-7d96602a25a3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.160405 Jul 20 13:56:20.592073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 531/1083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:21.183527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-461723c8-cc2c-4c42-a208-11645168e32b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:21.184474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-461723c8-cc2c-4c42-a208-11645168e32b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:21.190996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-461723c8-cc2c-4c42-a208-11645168e32b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:21.191447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-461723c8-cc2c-4c42-a208-11645168e32b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:21.192876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-461723c8-cc2c-4c42-a208-11645168e32b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:21.193376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-461723c8-cc2c-4c42-a208-11645168e32b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:21.222791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-461723c8-cc2c-4c42-a208-11645168e32b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043268 Jul 20 13:56:21.223857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 553/1084] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:21.608739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:21.609286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:21.616422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:21.616888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:21.617646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:21.618082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:21.748554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:21.756043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fb15feae-3683-4065-b42c-d6cff53612bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151239 Jul 20 13:56:21.756651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 532/1085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:22.234780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-af457c3f-cc8f-4abc-a4bd-8e94f741b6c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:22.235722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-af457c3f-cc8f-4abc-a4bd-8e94f741b6c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:22.242709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af457c3f-cc8f-4abc-a4bd-8e94f741b6c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:22.243155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af457c3f-cc8f-4abc-a4bd-8e94f741b6c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:22.243945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af457c3f-cc8f-4abc-a4bd-8e94f741b6c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:22.244415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af457c3f-cc8f-4abc-a4bd-8e94f741b6c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:22.273065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-af457c3f-cc8f-4abc-a4bd-8e94f741b6c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042283 Jul 20 13:56:22.273608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 554/1086] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:22.773765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:22.774365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:22.780763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:22.781202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:22.781951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:22.782380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:22.910813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:22.918483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1e64b307-ddcb-4476-bc26-3a91dcf95ba2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149162 Jul 20 13:56:22.925876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 533/1087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:23.287119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-86bb9dac-2a36-4c4e-9e14-a274e3d101b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:23.288004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-86bb9dac-2a36-4c4e-9e14-a274e3d101b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:23.298230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86bb9dac-2a36-4c4e-9e14-a274e3d101b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:23.298966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86bb9dac-2a36-4c4e-9e14-a274e3d101b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:23.300244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86bb9dac-2a36-4c4e-9e14-a274e3d101b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:23.300975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86bb9dac-2a36-4c4e-9e14-a274e3d101b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:23.338125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-86bb9dac-2a36-4c4e-9e14-a274e3d101b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056885 Jul 20 13:56:23.338700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 555/1088] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:23.934837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:23.935440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:23.941913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:23.942353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:23.943119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:23.943547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:24.075934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:24.083435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cbf82c98-46d8-4175-88df-ed96eb0f3204 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152481 Jul 20 13:56:24.083998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 534/1089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:24.350650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3bbbd4a1-ea32-4ea8-947c-344c4171dd69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:24.351554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3bbbd4a1-ea32-4ea8-947c-344c4171dd69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:24.358007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3bbbd4a1-ea32-4ea8-947c-344c4171dd69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:24.358448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3bbbd4a1-ea32-4ea8-947c-344c4171dd69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:24.359202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3bbbd4a1-ea32-4ea8-947c-344c4171dd69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:24.359630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3bbbd4a1-ea32-4ea8-947c-344c4171dd69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:24.387833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3bbbd4a1-ea32-4ea8-947c-344c4171dd69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041657 Jul 20 13:56:24.388403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 556/1090] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:25.100506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:25.101122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:25.107602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:25.108055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:25.108855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:25.109291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:25.237477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:25.244883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-03f2d1c8-ebf5-4938-b37f-1b12f3738bb8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148358 Jul 20 13:56:25.245445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 535/1091] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:25.398541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ce75a920-2833-4275-b4b7-1d182bb9ac5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:25.399466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ce75a920-2833-4275-b4b7-1d182bb9ac5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:25.406096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce75a920-2833-4275-b4b7-1d182bb9ac5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:25.406545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce75a920-2833-4275-b4b7-1d182bb9ac5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:25.407308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce75a920-2833-4275-b4b7-1d182bb9ac5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:25.407741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ce75a920-2833-4275-b4b7-1d182bb9ac5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:25.436364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ce75a920-2833-4275-b4b7-1d182bb9ac5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041819 Jul 20 13:56:25.436901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 557/1092] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:26.261675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:26.262271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:26.268810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:26.269251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:26.270525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:26.270954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:26.398356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:26.405978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5395fe15-e397-4df7-b4b1-4a233ba1f4ad tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148117 Jul 20 13:56:26.406550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 536/1093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:26.448483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-07910caf-2c94-4a35-96b6-ad9dcb794238 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:26.449353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-07910caf-2c94-4a35-96b6-ad9dcb794238 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:26.455708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07910caf-2c94-4a35-96b6-ad9dcb794238 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:26.456154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07910caf-2c94-4a35-96b6-ad9dcb794238 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:26.456970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07910caf-2c94-4a35-96b6-ad9dcb794238 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:26.457914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-07910caf-2c94-4a35-96b6-ad9dcb794238 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:26.486394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-07910caf-2c94-4a35-96b6-ad9dcb794238 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042562 Jul 20 13:56:26.486934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 558/1094] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:27.423847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:27.424487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:27.431426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:27.431872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:27.432668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:27.433099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:27.497544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-963a08f2-1c19-4b94-9cec-3f6d46a8fbac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:27.498455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-963a08f2-1c19-4b94-9cec-3f6d46a8fbac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:27.505227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-963a08f2-1c19-4b94-9cec-3f6d46a8fbac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:27.505674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-963a08f2-1c19-4b94-9cec-3f6d46a8fbac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:27.506433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-963a08f2-1c19-4b94-9cec-3f6d46a8fbac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:27.506871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-963a08f2-1c19-4b94-9cec-3f6d46a8fbac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:27.510597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:27.536533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-963a08f2-1c19-4b94-9cec-3f6d46a8fbac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042973 Jul 20 13:56:27.537090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 559/1095] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:27.566790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:27.574487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b737e9ce-b714-414d-9f0a-58a4292c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154558 Jul 20 13:56:27.575036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 537/1096] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:28.548317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cdbb7eb1-dd93-48b6-bdf5-939d5cd6996b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:28.549240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cdbb7eb1-dd93-48b6-bdf5-939d5cd6996b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:28.555895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdbb7eb1-dd93-48b6-bdf5-939d5cd6996b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:28.556389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdbb7eb1-dd93-48b6-bdf5-939d5cd6996b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:28.557148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdbb7eb1-dd93-48b6-bdf5-939d5cd6996b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:28.557582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdbb7eb1-dd93-48b6-bdf5-939d5cd6996b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:28.588312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cdbb7eb1-dd93-48b6-bdf5-939d5cd6996b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043932 Jul 20 13:56:28.588864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 560/1097] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:28.592092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:28.592748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:28.599136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:28.599586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:28.600374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:28.600809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:28.735655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:28.743735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8feeeaf1-a2c1-489d-a6e8-d7f421427f2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155681 Jul 20 13:56:28.744327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 538/1098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:56:29.599832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89f2eff9-6205-4b0a-ad8c-5957e4067183 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:29.600792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89f2eff9-6205-4b0a-ad8c-5957e4067183 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:29.607214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f2eff9-6205-4b0a-ad8c-5957e4067183 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:29.607669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f2eff9-6205-4b0a-ad8c-5957e4067183 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:29.608461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f2eff9-6205-4b0a-ad8c-5957e4067183 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:29.608904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f2eff9-6205-4b0a-ad8c-5957e4067183 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:29.637910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89f2eff9-6205-4b0a-ad8c-5957e4067183 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042034 Jul 20 13:56:29.638462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 561/1099] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:29.761182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:29.761791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:29.768259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:29.768711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:29.769474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:29.770555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:29.901182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:29.908582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-51d45a14-f2e0-432d-8670-2301499a2778 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151320 Jul 20 13:56:29.909156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 539/1100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:30.649558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-449633a5-5273-4684-8061-1f109f47665a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:30.650482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-449633a5-5273-4684-8061-1f109f47665a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:30.657019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-449633a5-5273-4684-8061-1f109f47665a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:30.657465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-449633a5-5273-4684-8061-1f109f47665a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:30.658227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-449633a5-5273-4684-8061-1f109f47665a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:30.658660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-449633a5-5273-4684-8061-1f109f47665a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:30.688165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-449633a5-5273-4684-8061-1f109f47665a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042579 Jul 20 13:56:30.688739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 562/1101] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:30.926172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:30.926777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:30.933330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:30.933770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:30.934517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:30.934946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:31.063238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:31.071499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe807219-9e2d-46b0-bb2c-8bb7b038edef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149134 Jul 20 13:56:31.072065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 540/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:31.701101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a042aac4-5889-4686-ae54-987e58e9bb91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:31.702021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a042aac4-5889-4686-ae54-987e58e9bb91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:31.708920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a042aac4-5889-4686-ae54-987e58e9bb91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:31.709396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a042aac4-5889-4686-ae54-987e58e9bb91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:31.710157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a042aac4-5889-4686-ae54-987e58e9bb91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:31.710588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a042aac4-5889-4686-ae54-987e58e9bb91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:31.739932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a042aac4-5889-4686-ae54-987e58e9bb91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043294 Jul 20 13:56:31.740605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 563/1103] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:32.089267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:32.089871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:32.096247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:32.096692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:32.097474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:32.098065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:32.227131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:32.234511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cdc3b006-c750-42ed-a872-885d87cee272 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149106 Jul 20 13:56:32.235072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 541/1104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:32.753359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f9f2f2cf-652d-467f-995a-5643d2df404f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:32.754711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f9f2f2cf-652d-467f-995a-5643d2df404f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:32.761183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9f2f2cf-652d-467f-995a-5643d2df404f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:32.761658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9f2f2cf-652d-467f-995a-5643d2df404f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:32.762391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9f2f2cf-652d-467f-995a-5643d2df404f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:32.762824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9f2f2cf-652d-467f-995a-5643d2df404f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:32.790988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f9f2f2cf-652d-467f-995a-5643d2df404f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041743 Jul 20 13:56:32.791522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 564/1105] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:33.251936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:33.252562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:33.259008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:33.259449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:33.260219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:33.260654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:33.392089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:33.399520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17bb8a69-ab3e-47e1-80b4-a4a3fd83642b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151390 Jul 20 13:56:33.400102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 542/1106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:33.802731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7bb948d2-9a62-42e0-b0a5-c9815073bd0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:33.803643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7bb948d2-9a62-42e0-b0a5-c9815073bd0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:33.810041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bb948d2-9a62-42e0-b0a5-c9815073bd0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:33.810486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bb948d2-9a62-42e0-b0a5-c9815073bd0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:33.811244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bb948d2-9a62-42e0-b0a5-c9815073bd0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:33.811678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7bb948d2-9a62-42e0-b0a5-c9815073bd0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:33.841004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7bb948d2-9a62-42e0-b0a5-c9815073bd0f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042308 Jul 20 13:56:33.841548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 565/1107] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:34.417609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:34.418292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:34.424860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:34.425312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:34.426100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:34.426536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:34.554306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:34.561999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-43875016-65bd-4949-8a63-f4d626af4f1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148534 Jul 20 13:56:34.562605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 543/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:34.853524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f74420ea-0bbe-44da-be93-1717503849f5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:34.854341 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f74420ea-0bbe-44da-be93-1717503849f5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:34.860749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f74420ea-0bbe-44da-be93-1717503849f5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:34.861188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f74420ea-0bbe-44da-be93-1717503849f5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:34.861939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f74420ea-0bbe-44da-be93-1717503849f5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:34.862362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f74420ea-0bbe-44da-be93-1717503849f5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:34.890505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f74420ea-0bbe-44da-be93-1717503849f5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041126 Jul 20 13:56:34.891030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 566/1109] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:35.579768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:35.580443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:35.587572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:35.588014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:35.588804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:35.589257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:35.721605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:35.729535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b5a95b77-4443-43fd-8b5b-b855b19f7b4e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153593 Jul 20 13:56:35.730103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 544/1110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:35.901697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-507eaba4-63c7-4114-86a6-28fbdaed5c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:35.902618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-507eaba4-63c7-4114-86a6-28fbdaed5c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:35.909126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507eaba4-63c7-4114-86a6-28fbdaed5c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:35.909581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507eaba4-63c7-4114-86a6-28fbdaed5c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:35.911018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507eaba4-63c7-4114-86a6-28fbdaed5c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:35.911455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-507eaba4-63c7-4114-86a6-28fbdaed5c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:35.939265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-507eaba4-63c7-4114-86a6-28fbdaed5c6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041525 Jul 20 13:56:35.939800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 567/1111] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:36.747357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:36.747960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:36.755091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:36.755533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:36.756323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:36.756759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:36.883677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:36.885909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:36.892487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4c1b9f60-83d8-43fa-b309-b174b13d99c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149180 Jul 20 13:56:36.893055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 545/1112] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:36.951233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9103288c-1050-4c22-b2ca-763820da7a92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:36.952182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9103288c-1050-4c22-b2ca-763820da7a92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:36.959121 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9103288c-1050-4c22-b2ca-763820da7a92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:36.959565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9103288c-1050-4c22-b2ca-763820da7a92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:36.960361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9103288c-1050-4c22-b2ca-763820da7a92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:36.960801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9103288c-1050-4c22-b2ca-763820da7a92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:36.989423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9103288c-1050-4c22-b2ca-763820da7a92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042386 Jul 20 13:56:36.990195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 568/1113] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:37.910436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:37.911036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:37.917503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:37.917945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:37.918724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:37.919153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:38.001480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-45922671-da4a-4e22-839a-335c524f0705 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:38.002428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-45922671-da4a-4e22-839a-335c524f0705 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:38.009397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45922671-da4a-4e22-839a-335c524f0705 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:38.009847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45922671-da4a-4e22-839a-335c524f0705 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:38.010617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45922671-da4a-4e22-839a-335c524f0705 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:38.011054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45922671-da4a-4e22-839a-335c524f0705 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:38.040278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-45922671-da4a-4e22-839a-335c524f0705 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042671 Jul 20 13:56:38.040846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 569/1114] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:38.051690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:38.059253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6ee11a2e-ec7a-4818-a3b6-554d5400fd5e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153216 Jul 20 13:56:38.059809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 546/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:39.052587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-81fa1726-3c16-4ac5-b51f-bd0c09b5b16d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:39.053534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-81fa1726-3c16-4ac5-b51f-bd0c09b5b16d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:39.059966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81fa1726-3c16-4ac5-b51f-bd0c09b5b16d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:39.060447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81fa1726-3c16-4ac5-b51f-bd0c09b5b16d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:39.061216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81fa1726-3c16-4ac5-b51f-bd0c09b5b16d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:39.061650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81fa1726-3c16-4ac5-b51f-bd0c09b5b16d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:39.076755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:39.077380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:39.084107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:39.084591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:39.085346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:39.085773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:39.091213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-81fa1726-3c16-4ac5-b51f-bd0c09b5b16d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042708 Jul 20 13:56:39.091769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 570/1116] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:39.215783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:39.223229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f647ec31-153c-46a1-9c1b-87c5ef1a0839 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150847 Jul 20 13:56:39.223788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 547/1117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:40.103369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2c9ff81c-27c5-4b13-92ff-b4ae4b34512e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:40.104318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2c9ff81c-27c5-4b13-92ff-b4ae4b34512e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:40.110916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c9ff81c-27c5-4b13-92ff-b4ae4b34512e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:40.111361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c9ff81c-27c5-4b13-92ff-b4ae4b34512e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:40.112116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c9ff81c-27c5-4b13-92ff-b4ae4b34512e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:40.112605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c9ff81c-27c5-4b13-92ff-b4ae4b34512e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:40.141111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2c9ff81c-27c5-4b13-92ff-b4ae4b34512e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042201 Jul 20 13:56:40.141623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 571/1118] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:40.240663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:40.241269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:40.243523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:40.248973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:40.249452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:40.250236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:40.250666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:40.379464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:40.387021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-390a1532-f95f-4097-b45d-c0ed0424997e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150863 Jul 20 13:56:40.387579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 548/1119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:41.153068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b2667865-345b-4ad1-9ee6-27c2c0d0517a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:41.154152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b2667865-345b-4ad1-9ee6-27c2c0d0517a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:41.160561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2667865-345b-4ad1-9ee6-27c2c0d0517a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:41.160982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2667865-345b-4ad1-9ee6-27c2c0d0517a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:41.161748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2667865-345b-4ad1-9ee6-27c2c0d0517a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:41.162173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2667865-345b-4ad1-9ee6-27c2c0d0517a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:41.190135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b2667865-345b-4ad1-9ee6-27c2c0d0517a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041145 Jul 20 13:56:41.190668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 572/1120] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:41.404708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:41.405256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:41.411655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:41.412102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:41.412897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:41.413330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:41.547132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:41.555155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e80fd2ed-c4e7-4cb0-8fc9-030771c0e14c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154457 Jul 20 13:56:41.555719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 549/1121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:42.202809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7d7f23a1-46e7-4b32-b092-82a2850a5f41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:42.203762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7d7f23a1-46e7-4b32-b092-82a2850a5f41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:42.210440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d7f23a1-46e7-4b32-b092-82a2850a5f41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:42.210894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d7f23a1-46e7-4b32-b092-82a2850a5f41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:42.211659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d7f23a1-46e7-4b32-b092-82a2850a5f41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:42.212096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d7f23a1-46e7-4b32-b092-82a2850a5f41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:42.241169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7d7f23a1-46e7-4b32-b092-82a2850a5f41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042367 Jul 20 13:56:42.241714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 573/1122] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:42.572083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:42.572968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:42.579660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:42.580101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:42.580902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:42.581335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:42.710059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:42.717582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f8dbb146-3aa4-4fb4-bc29-f3df71afbd88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149316 Jul 20 13:56:42.718073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 550/1123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:43.252956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-58609998-16ff-49b3-8134-4cdd8dc0189c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:43.253872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-58609998-16ff-49b3-8134-4cdd8dc0189c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:43.260363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58609998-16ff-49b3-8134-4cdd8dc0189c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:43.260811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58609998-16ff-49b3-8134-4cdd8dc0189c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:43.261576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58609998-16ff-49b3-8134-4cdd8dc0189c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:43.262009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58609998-16ff-49b3-8134-4cdd8dc0189c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:43.290590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-58609998-16ff-49b3-8134-4cdd8dc0189c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041650 Jul 20 13:56:43.291143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 574/1124] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:43.734827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:43.735438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:43.742091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:43.742544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:43.743313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:43.743750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:43.883513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:43.891164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e4afc1b9-a9b3-43bc-99fc-f00b6b9b6b82 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.160243 Jul 20 13:56:43.891736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 551/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:44.302591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-23bc6fa1-e20f-477d-8af7-223b6883a447 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:44.303636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-23bc6fa1-e20f-477d-8af7-223b6883a447 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:44.306065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=58 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:44.311414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23bc6fa1-e20f-477d-8af7-223b6883a447 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:44.311859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23bc6fa1-e20f-477d-8af7-223b6883a447 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:44.312662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23bc6fa1-e20f-477d-8af7-223b6883a447 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:44.313098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23bc6fa1-e20f-477d-8af7-223b6883a447 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:44.337743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:44.342723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-23bc6fa1-e20f-477d-8af7-223b6883a447 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044470 Jul 20 13:56:44.343272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 575/1126] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:44.908732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:44.909339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:44.916478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:44.916923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:44.917680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:44.918113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:45.044854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:45.052251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cf781364-37b9-418a-bf00-b28d6a4d4aed tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147370 Jul 20 13:56:45.052813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 552/1127] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:45.354517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1105c283-af36-419b-acb4-7a53a9fb1655 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:45.355464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1105c283-af36-419b-acb4-7a53a9fb1655 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:45.362258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1105c283-af36-419b-acb4-7a53a9fb1655 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:45.362704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1105c283-af36-419b-acb4-7a53a9fb1655 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:45.363481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1105c283-af36-419b-acb4-7a53a9fb1655 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:45.363918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1105c283-af36-419b-acb4-7a53a9fb1655 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:45.392294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1105c283-af36-419b-acb4-7a53a9fb1655 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041845 Jul 20 13:56:45.392851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 576/1128] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:46.069828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:46.070471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:46.077263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:46.077716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:46.078489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:46.078927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:46.216679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:46.224597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-46d2a85e-5797-4336-8761-c04d786f9c8a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.158620 Jul 20 13:56:46.225152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 553/1129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:56:46.404551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fca93092-5943-4948-937c-c0a01bce1068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:46.405468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fca93092-5943-4948-937c-c0a01bce1068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:46.412292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fca93092-5943-4948-937c-c0a01bce1068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:46.413370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fca93092-5943-4948-937c-c0a01bce1068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:46.414179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fca93092-5943-4948-937c-c0a01bce1068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:46.414643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fca93092-5943-4948-937c-c0a01bce1068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:46.443404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fca93092-5943-4948-937c-c0a01bce1068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042821 Jul 20 13:56:46.443956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 577/1130] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:47.241329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:47.241931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:47.248068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:47.248609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:47.249367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:47.249794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:47.382837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:47.390229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f0d853b6-e1a6-4e4f-a7d9-9228cac92536 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152893 Jul 20 13:56:47.390788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 554/1131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:47.455275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-df10ec21-6fa5-4348-8273-4ef04ade2257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:47.456222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-df10ec21-6fa5-4348-8273-4ef04ade2257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:47.463266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df10ec21-6fa5-4348-8273-4ef04ade2257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:47.463705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df10ec21-6fa5-4348-8273-4ef04ade2257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:47.464478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df10ec21-6fa5-4348-8273-4ef04ade2257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:47.464904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df10ec21-6fa5-4348-8273-4ef04ade2257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:47.492718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-df10ec21-6fa5-4348-8273-4ef04ade2257 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041354 Jul 20 13:56:47.493188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 578/1132] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:48.408377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:48.408945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:48.416102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:48.416573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:48.417383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:48.417880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:48.504233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-868b8297-0f1f-4a09-a5f3-7e4dc1ea0fb4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:48.505264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-868b8297-0f1f-4a09-a5f3-7e4dc1ea0fb4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:48.511276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-868b8297-0f1f-4a09-a5f3-7e4dc1ea0fb4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:48.511722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-868b8297-0f1f-4a09-a5f3-7e4dc1ea0fb4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:48.512512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-868b8297-0f1f-4a09-a5f3-7e4dc1ea0fb4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:48.512944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-868b8297-0f1f-4a09-a5f3-7e4dc1ea0fb4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:48.546070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-868b8297-0f1f-4a09-a5f3-7e4dc1ea0fb4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045662 Jul 20 13:56:48.546641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 579/1133] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:48.562964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:48.570528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7c4267e2-f52e-4503-b619-2136055f5b0a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.166144 Jul 20 13:56:48.571125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 555/1134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:49.558231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f13df6e3-f924-4462-8195-6b1cae29ec36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:49.559142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f13df6e3-f924-4462-8195-6b1cae29ec36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:49.565554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f13df6e3-f924-4462-8195-6b1cae29ec36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:49.565999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f13df6e3-f924-4462-8195-6b1cae29ec36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:49.566756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f13df6e3-f924-4462-8195-6b1cae29ec36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:49.567190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f13df6e3-f924-4462-8195-6b1cae29ec36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:49.586719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:49.587327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:49.593699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:49.594146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:49.594909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:49.595341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:49.596995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f13df6e3-f924-4462-8195-6b1cae29ec36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042782 Jul 20 13:56:49.597698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 580/1135] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:49.732066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:49.739486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-326fdd1c-ea96-4e12-89a3-76ed3f3d2462 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.156586 Jul 20 13:56:49.740057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 556/1136] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:56:50.609100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1ceb3539-85ee-4e93-bf6a-255fa880e386 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:50.609933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1ceb3539-85ee-4e93-bf6a-255fa880e386 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:50.617128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ceb3539-85ee-4e93-bf6a-255fa880e386 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:50.617574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ceb3539-85ee-4e93-bf6a-255fa880e386 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:50.618343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ceb3539-85ee-4e93-bf6a-255fa880e386 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:50.618778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ceb3539-85ee-4e93-bf6a-255fa880e386 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:50.647081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1ceb3539-85ee-4e93-bf6a-255fa880e386 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042033 Jul 20 13:56:50.647637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 581/1137] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:50.757121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:50.757739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:50.764697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:50.765145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:50.765943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:50.766378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:50.895147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:50.903140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2e18be7e-0326-46aa-9bce-57f9cf1a5933 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149892 Jul 20 13:56:50.903710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 557/1138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:51.659028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-17d0131f-685e-45d3-b44a-596f47f15967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:51.659950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-17d0131f-685e-45d3-b44a-596f47f15967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:51.666433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17d0131f-685e-45d3-b44a-596f47f15967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:51.666878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17d0131f-685e-45d3-b44a-596f47f15967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:51.667669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17d0131f-685e-45d3-b44a-596f47f15967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:51.668102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17d0131f-685e-45d3-b44a-596f47f15967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:51.698659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-17d0131f-685e-45d3-b44a-596f47f15967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043615 Jul 20 13:56:51.699204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 582/1139] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:51.920633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:51.921247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:51.927664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:51.928111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:51.929607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:51.930039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:52.059159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:52.072313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-78c74402-0a99-4efe-93f5-2ffdbc3b5557 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155711 Jul 20 13:56:52.072907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 558/1140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:52.710690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2fc52c6b-ffb0-404d-be43-87cd39d04b3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:52.711656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2fc52c6b-ffb0-404d-be43-87cd39d04b3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:52.718244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fc52c6b-ffb0-404d-be43-87cd39d04b3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:52.718715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fc52c6b-ffb0-404d-be43-87cd39d04b3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:52.719526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fc52c6b-ffb0-404d-be43-87cd39d04b3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:52.719984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fc52c6b-ffb0-404d-be43-87cd39d04b3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:52.748864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2fc52c6b-ffb0-404d-be43-87cd39d04b3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042931 Jul 20 13:56:52.749425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 583/1141] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:53.089419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:53.090007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:53.096491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:53.096932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:53.097692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:53.098122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:53.224561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:53.231966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-447bb2ff-847c-4709-a211-0b19048ac102 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.146411 Jul 20 13:56:53.232564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 559/1142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:53.761027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c482c2ae-c1c3-4c96-a523-a1eef0ce1ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:53.761941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c482c2ae-c1c3-4c96-a523-a1eef0ce1ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:53.768401 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c482c2ae-c1c3-4c96-a523-a1eef0ce1ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:53.768846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c482c2ae-c1c3-4c96-a523-a1eef0ce1ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:53.769605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c482c2ae-c1c3-4c96-a523-a1eef0ce1ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:53.770032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c482c2ae-c1c3-4c96-a523-a1eef0ce1ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:53.797833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c482c2ae-c1c3-4c96-a523-a1eef0ce1ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041356 Jul 20 13:56:53.798372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 584/1143] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:54.248447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:54.249085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:54.255520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:54.255967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:54.256753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:54.257194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:54.387886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:54.395286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae8a9fb4-afa4-4308-a3f6-d45f3f22f9cf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150727 Jul 20 13:56:54.395847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 560/1144] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:54.809589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d3b0b320-6606-40de-b403-a0f52f697450 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:54.810745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d3b0b320-6606-40de-b403-a0f52f697450 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:54.817717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3b0b320-6606-40de-b403-a0f52f697450 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:54.818157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3b0b320-6606-40de-b403-a0f52f697450 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:54.818910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3b0b320-6606-40de-b403-a0f52f697450 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:54.819334 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3b0b320-6606-40de-b403-a0f52f697450 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:54.847927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d3b0b320-6606-40de-b403-a0f52f697450 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042463 Jul 20 13:56:54.848501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 585/1145] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:55.412220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:55.412824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:55.419786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:55.420248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:55.420996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:55.421422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:55.552433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:55.560146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fbb44706-1516-4ae4-bd71-4eee21dadc80 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151798 Jul 20 13:56:55.560783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 561/1146] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:55.859635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a12648fc-610e-4ede-860f-d7a6ad27586a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:55.860583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a12648fc-610e-4ede-860f-d7a6ad27586a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:55.867017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a12648fc-610e-4ede-860f-d7a6ad27586a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:55.867464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a12648fc-610e-4ede-860f-d7a6ad27586a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:55.868252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a12648fc-610e-4ede-860f-d7a6ad27586a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:55.868686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a12648fc-610e-4ede-860f-d7a6ad27586a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:55.896706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a12648fc-610e-4ede-860f-d7a6ad27586a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041171 Jul 20 13:56:55.897237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 586/1147] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:56.578220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:56.578750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:56.585195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:56.585640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:56.586397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:56.586831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:56.601764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:56:56.716066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:56.723410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef718ece-0f1a-409d-8a7e-0a998ac36785 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149226 Jul 20 13:56:56.723970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 562/1148] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:56.909055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b93fec13-2db1-4449-91fa-59fc6a01c513 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:56.910005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b93fec13-2db1-4449-91fa-59fc6a01c513 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:56.917223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b93fec13-2db1-4449-91fa-59fc6a01c513 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:56.917666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b93fec13-2db1-4449-91fa-59fc6a01c513 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:56.918423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b93fec13-2db1-4449-91fa-59fc6a01c513 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:56.918859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b93fec13-2db1-4449-91fa-59fc6a01c513 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:56.946564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b93fec13-2db1-4449-91fa-59fc6a01c513 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041494 Jul 20 13:56:56.947374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 587/1149] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:57.742651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:57.743263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:57.749918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:57.750390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:57.751153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:57.751588 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:57.886534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:57.893896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4a705f53-3bdd-4087-9fef-449350d30724 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.156065 Jul 20 13:56:57.894460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 563/1150] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:56:57.958602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6a3f03ba-8c39-4c9c-98fe-9d75b4445d0b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:57.959794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6a3f03ba-8c39-4c9c-98fe-9d75b4445d0b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:57.966601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a3f03ba-8c39-4c9c-98fe-9d75b4445d0b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:57.967047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a3f03ba-8c39-4c9c-98fe-9d75b4445d0b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:57.968080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a3f03ba-8c39-4c9c-98fe-9d75b4445d0b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:57.968554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a3f03ba-8c39-4c9c-98fe-9d75b4445d0b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:57.996128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6a3f03ba-8c39-4c9c-98fe-9d75b4445d0b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041687 Jul 20 13:56:57.996695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 588/1151] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:56:58.915145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:58.916326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:58.925595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:58.926043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:58.926811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:58.927244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:59.007101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-463b5081-e2b3-4ed7-9d47-5f2bda3fc472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:56:59.008700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-463b5081-e2b3-4ed7-9d47-5f2bda3fc472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:56:59.015122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-463b5081-e2b3-4ed7-9d47-5f2bda3fc472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:59.015569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-463b5081-e2b3-4ed7-9d47-5f2bda3fc472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:59.016399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-463b5081-e2b3-4ed7-9d47-5f2bda3fc472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:56:59.016798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-463b5081-e2b3-4ed7-9d47-5f2bda3fc472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:56:59.045879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-463b5081-e2b3-4ed7-9d47-5f2bda3fc472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042824 Jul 20 13:56:59.046443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 589/1152] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:56:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:56:59.056090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:56:59.063673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-875f1d21-cc0f-45dd-a16b-3ccadc9c699f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155878 Jul 20 13:56:59.064249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 564/1153] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:56:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:00.057938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c9d3ff6e-180d-4255-9f38-185401896547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:00.058843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c9d3ff6e-180d-4255-9f38-185401896547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:00.065258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9d3ff6e-180d-4255-9f38-185401896547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:00.065695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9d3ff6e-180d-4255-9f38-185401896547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:00.066448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9d3ff6e-180d-4255-9f38-185401896547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:00.066876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9d3ff6e-180d-4255-9f38-185401896547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:00.081277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:00.081928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:00.088824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:00.089274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:00.090045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:00.090482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:00.096365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c9d3ff6e-180d-4255-9f38-185401896547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042346 Jul 20 13:57:00.097051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 590/1154] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:00.221802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:00.229605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a3dea44b-63e7-41e6-889e-be842dbd36da tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152139 Jul 20 13:57:00.230168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 565/1155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:01.108430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4a264aab-65d5-4442-854c-bcd7492b0fdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:01.109461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4a264aab-65d5-4442-854c-bcd7492b0fdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:01.115977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a264aab-65d5-4442-854c-bcd7492b0fdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:01.116448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a264aab-65d5-4442-854c-bcd7492b0fdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:01.117768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a264aab-65d5-4442-854c-bcd7492b0fdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:01.118196 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4a264aab-65d5-4442-854c-bcd7492b0fdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:01.146061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4a264aab-65d5-4442-854c-bcd7492b0fdc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041600 Jul 20 13:57:01.146612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 591/1156] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:57:01.247176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:01.248169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:01.255184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:01.255637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:01.256427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:01.256861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:01.392606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:01.400622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1cdb5a67-be1a-485d-ac6e-d7c3ed6babd5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.157367 Jul 20 13:57:01.401185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 566/1157] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:02.157925 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9de06f47-1756-4d43-a549-2dc6a2a463e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:02.158854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9de06f47-1756-4d43-a549-2dc6a2a463e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:02.165299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de06f47-1756-4d43-a549-2dc6a2a463e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:02.165750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de06f47-1756-4d43-a549-2dc6a2a463e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:02.166517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de06f47-1756-4d43-a549-2dc6a2a463e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:02.166952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de06f47-1756-4d43-a549-2dc6a2a463e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:02.180717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:02.197097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9de06f47-1756-4d43-a549-2dc6a2a463e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042922 Jul 20 13:57:02.197648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 592/1158] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:02.417803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:02.418351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:02.424830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:02.425278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:02.426041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:02.426554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:02.558224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:02.565664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f71d77e-6fc6-4ea4-8733-42eee88746d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152272 Jul 20 13:57:02.566249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 567/1159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:03.208772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4bc397e6-ca78-4030-b3a8-4386592fc315 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:03.209684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4bc397e6-ca78-4030-b3a8-4386592fc315 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:03.216724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bc397e6-ca78-4030-b3a8-4386592fc315 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:03.217188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bc397e6-ca78-4030-b3a8-4386592fc315 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:03.217942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bc397e6-ca78-4030-b3a8-4386592fc315 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:03.218382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4bc397e6-ca78-4030-b3a8-4386592fc315 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:03.245990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4bc397e6-ca78-4030-b3a8-4386592fc315 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041226 Jul 20 13:57:03.246523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 593/1160] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:03.582929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:03.583445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:03.590012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:03.590462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:03.591226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:03.591661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:03.722546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:03.730054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-54b81f2c-e34e-4b42-b808-a67bdacecd30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151082 Jul 20 13:57:03.730632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 568/1161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:04.256957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4f532d6b-d1c8-4c2f-bff4-2bddbf0df2e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:04.257861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4f532d6b-d1c8-4c2f-bff4-2bddbf0df2e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:04.264425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f532d6b-d1c8-4c2f-bff4-2bddbf0df2e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:04.264866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f532d6b-d1c8-4c2f-bff4-2bddbf0df2e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:04.265622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f532d6b-d1c8-4c2f-bff4-2bddbf0df2e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:04.266046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f532d6b-d1c8-4c2f-bff4-2bddbf0df2e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:04.294806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4f532d6b-d1c8-4c2f-bff4-2bddbf0df2e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041892 Jul 20 13:57:04.295332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 594/1162] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:04.746818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:04.747420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:04.753834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:04.754318 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:04.755029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:04.755455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:04.881683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:04.889567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-baad5ac2-df17-4ffe-82bb-740585c32880 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.146595 Jul 20 13:57:04.890069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 569/1163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:05.305850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a7b7a2eb-d716-43c5-929a-e4d25c2e88c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:05.307374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a7b7a2eb-d716-43c5-929a-e4d25c2e88c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:05.313830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b7a2eb-d716-43c5-929a-e4d25c2e88c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:05.314303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b7a2eb-d716-43c5-929a-e4d25c2e88c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:05.315070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b7a2eb-d716-43c5-929a-e4d25c2e88c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:05.315508 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7b7a2eb-d716-43c5-929a-e4d25c2e88c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:05.343810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a7b7a2eb-d716-43c5-929a-e4d25c2e88c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041941 Jul 20 13:57:05.344376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 595/1164] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:05.838099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:57:05.838871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 13:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 13:57:05.907198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:05.907830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:05.914267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:05.914710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:05.915467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:05.915898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:06.045027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:06.052399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b5da626-a4d2-487b-964e-3f77242723d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149019 Jul 20 13:57:06.052964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 570/1165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:06.355433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-17cd685a-c133-44c2-9fa1-ce8f992ef019 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:06.356379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-17cd685a-c133-44c2-9fa1-ce8f992ef019 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:06.362944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17cd685a-c133-44c2-9fa1-ce8f992ef019 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:06.363392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17cd685a-c133-44c2-9fa1-ce8f992ef019 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:06.364256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17cd685a-c133-44c2-9fa1-ce8f992ef019 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:06.364695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17cd685a-c133-44c2-9fa1-ce8f992ef019 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:06.393594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-17cd685a-c133-44c2-9fa1-ce8f992ef019 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042216 Jul 20 13:57:06.394138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 596/1166] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:07.068575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:07.069192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:07.076455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:07.076906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:07.077681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:07.078116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:07.205327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:07.212747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f0bba3fc-d292-4b19-9df1-65a2f4e52d05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148037 Jul 20 13:57:07.213311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 571/1167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:07.405157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d5a2a509-66d8-46c5-b6a5-dc3f5b61f64e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:07.406076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d5a2a509-66d8-46c5-b6a5-dc3f5b61f64e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:07.412642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5a2a509-66d8-46c5-b6a5-dc3f5b61f64e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:07.413091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5a2a509-66d8-46c5-b6a5-dc3f5b61f64e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:07.413855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5a2a509-66d8-46c5-b6a5-dc3f5b61f64e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:07.414292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5a2a509-66d8-46c5-b6a5-dc3f5b61f64e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:07.445392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d5a2a509-66d8-46c5-b6a5-dc3f5b61f64e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043893 Jul 20 13:57:07.446392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 597/1168] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:08.229678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:08.230284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:08.237678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:08.238136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:08.239001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:08.239435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:08.366452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:08.374296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5f62c76d-b344-4e33-8757-cc7de2fa48b6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148527 Jul 20 13:57:08.374861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 572/1169] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:08.458282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-652d974d-c063-4cd2-aa7e-44f4eaa63e78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:08.459202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-652d974d-c063-4cd2-aa7e-44f4eaa63e78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:08.465628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-652d974d-c063-4cd2-aa7e-44f4eaa63e78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:08.466922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-652d974d-c063-4cd2-aa7e-44f4eaa63e78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:08.467699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-652d974d-c063-4cd2-aa7e-44f4eaa63e78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:08.468137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-652d974d-c063-4cd2-aa7e-44f4eaa63e78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:08.497364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-652d974d-c063-4cd2-aa7e-44f4eaa63e78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042987 Jul 20 13:57:08.497851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 598/1170] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:09.392670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:09.394233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:09.401815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:09.402260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:09.403030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:09.403465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:09.508915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-67be75d7-8787-498e-b9bf-8a9a15a310e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:09.509836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-67be75d7-8787-498e-b9bf-8a9a15a310e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:09.516936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67be75d7-8787-498e-b9bf-8a9a15a310e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:09.517390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67be75d7-8787-498e-b9bf-8a9a15a310e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:09.518313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67be75d7-8787-498e-b9bf-8a9a15a310e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:09.518732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67be75d7-8787-498e-b9bf-8a9a15a310e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:09.539619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:09.547239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d367cf51-bc6d-41d3-9a45-51011f8b590b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.159300 Jul 20 13:57:09.547721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-67be75d7-8787-498e-b9bf-8a9a15a310e7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042786 Jul 20 13:57:09.547871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 573/1171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:09.548281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 599/1172] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:57:10.559204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-31fe30ae-350d-4162-928b-dda93bd6bb14 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:10.560118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-31fe30ae-350d-4162-928b-dda93bd6bb14 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:10.562443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:10.563767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:10.564506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:10.568498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31fe30ae-350d-4162-928b-dda93bd6bb14 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:10.568967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31fe30ae-350d-4162-928b-dda93bd6bb14 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:10.569728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31fe30ae-350d-4162-928b-dda93bd6bb14 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:10.570157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31fe30ae-350d-4162-928b-dda93bd6bb14 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:10.570657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:10.571098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:10.571852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:10.572559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:10.600741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-31fe30ae-350d-4162-928b-dda93bd6bb14 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045535 Jul 20 13:57:10.601541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 574/1173] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:10.705738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:10.713121 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7a3dddf9-0573-4410-83df-c87d3b4c9fe9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153031 Jul 20 13:57:10.714336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 600/1174] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:11.612587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2ce89656-b8b4-4d2c-bdcf-8ee2cb21b581 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:11.613418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2ce89656-b8b4-4d2c-bdcf-8ee2cb21b581 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:11.619830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ce89656-b8b4-4d2c-bdcf-8ee2cb21b581 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:11.620308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ce89656-b8b4-4d2c-bdcf-8ee2cb21b581 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:11.621575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ce89656-b8b4-4d2c-bdcf-8ee2cb21b581 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:11.622025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2ce89656-b8b4-4d2c-bdcf-8ee2cb21b581 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:11.651609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2ce89656-b8b4-4d2c-bdcf-8ee2cb21b581 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043100 Jul 20 13:57:11.652169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 575/1175] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:11.731239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:11.731830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:11.738246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:11.738749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:11.739452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:11.739889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:11.866735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:11.874873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-79d78556-bfac-491e-a0cd-755f4ceb71a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148075 Jul 20 13:57:11.875432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 601/1176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:12.663103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d37718fd-8cd8-4db2-93ea-50125e270746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:12.664039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d37718fd-8cd8-4db2-93ea-50125e270746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:12.670985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d37718fd-8cd8-4db2-93ea-50125e270746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:12.671427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d37718fd-8cd8-4db2-93ea-50125e270746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:12.672182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d37718fd-8cd8-4db2-93ea-50125e270746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:12.672637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d37718fd-8cd8-4db2-93ea-50125e270746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:12.701379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d37718fd-8cd8-4db2-93ea-50125e270746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042341 Jul 20 13:57:12.701915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 576/1177] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:12.890652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:12.891293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:12.897821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:12.898269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:12.899038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:12.899468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:13.065893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:13.073770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c43a27a3-3948-4136-8bdf-fb7aeb29e0bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.186912 Jul 20 13:57:13.074366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 602/1178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:13.713344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2e1d91d1-a6c5-46ae-9e07-92bc7fa84984 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:13.714254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2e1d91d1-a6c5-46ae-9e07-92bc7fa84984 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:13.721149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e1d91d1-a6c5-46ae-9e07-92bc7fa84984 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:13.721584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e1d91d1-a6c5-46ae-9e07-92bc7fa84984 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:13.722340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e1d91d1-a6c5-46ae-9e07-92bc7fa84984 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:13.722771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e1d91d1-a6c5-46ae-9e07-92bc7fa84984 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:13.751747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2e1d91d1-a6c5-46ae-9e07-92bc7fa84984 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042338 Jul 20 13:57:13.752248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 577/1179] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:14.090598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:14.091131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:14.097505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:14.097943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:14.098694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:14.099119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:14.227970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:14.235601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1b4dde46-f007-4aa0-a03a-391f4e7e8813 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149497 Jul 20 13:57:14.236375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 603/1180] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:14.827763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-35c7432d-3ea3-4125-a4e3-afa65f5555fe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:14.828734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-35c7432d-3ea3-4125-a4e3-afa65f5555fe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:14.834907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35c7432d-3ea3-4125-a4e3-afa65f5555fe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:14.835360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35c7432d-3ea3-4125-a4e3-afa65f5555fe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:14.836127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35c7432d-3ea3-4125-a4e3-afa65f5555fe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:14.836593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35c7432d-3ea3-4125-a4e3-afa65f5555fe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:14.865125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-35c7432d-3ea3-4125-a4e3-afa65f5555fe tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105613 Jul 20 13:57:14.865675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 578/1181] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:15.252817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:15.253371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:15.255617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=58 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:15.261084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:15.261529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:15.262286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:15.262747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:15.391547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:15.399004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9e1a344c-d1ba-4a84-a8ee-d76efd3bff8f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150119 Jul 20 13:57:15.399563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 604/1182] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:15.877061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-605203b6-e8e2-4e74-9681-f6b033ae9f72 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:15.877972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-605203b6-e8e2-4e74-9681-f6b033ae9f72 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:15.884451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-605203b6-e8e2-4e74-9681-f6b033ae9f72 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:15.884897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-605203b6-e8e2-4e74-9681-f6b033ae9f72 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:15.885653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-605203b6-e8e2-4e74-9681-f6b033ae9f72 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:15.886130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-605203b6-e8e2-4e74-9681-f6b033ae9f72 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:15.890311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:15.915125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-605203b6-e8e2-4e74-9681-f6b033ae9f72 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042142 Jul 20 13:57:15.915670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 579/1183] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:16.416678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:16.417288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:16.424311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:16.424759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:16.425523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:16.425955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:16.557268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:16.564739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-df1769ce-948e-4e21-86e6-37ce0b9da3a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151952 Jul 20 13:57:16.565295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 605/1184] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:16.926769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fd77cd53-1287-4bd9-9c64-f37e620351cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:16.929085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fd77cd53-1287-4bd9-9c64-f37e620351cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:16.935475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd77cd53-1287-4bd9-9c64-f37e620351cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:16.935928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd77cd53-1287-4bd9-9c64-f37e620351cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:16.936735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd77cd53-1287-4bd9-9c64-f37e620351cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:16.937174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd77cd53-1287-4bd9-9c64-f37e620351cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:16.967813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fd77cd53-1287-4bd9-9c64-f37e620351cf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044547 Jul 20 13:57:16.968261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 580/1185] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:17.037462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:17.037958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:17.043827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:17.044304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:17.045083 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:17.045497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:17.582411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:17.582952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:17.589257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:17.589719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:17.590483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:17.591477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:17.720095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:17.727598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d2090d3e-92d7-4631-893c-8da3100ecb2c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149160 Jul 20 13:57:17.728164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 581/1186] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:17.979222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-61b58577-4704-403d-9fb9-9f0fce586959 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:17.980148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-61b58577-4704-403d-9fb9-9f0fce586959 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:17.986515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b58577-4704-403d-9fb9-9f0fce586959 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:17.986968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b58577-4704-403d-9fb9-9f0fce586959 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:17.987738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b58577-4704-403d-9fb9-9f0fce586959 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:17.988177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b58577-4704-403d-9fb9-9f0fce586959 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:18.017946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-61b58577-4704-403d-9fb9-9f0fce586959 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042792 Jul 20 13:57:18.018505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 582/1187] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:57:18.744967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:18.745495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:18.752767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:18.753216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:18.753983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:18.754418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:18.883962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:18.891490 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c283502e-2056-46f1-8a91-65b4f6bf2266 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150464 Jul 20 13:57:18.892272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 583/1188] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:19.030086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2040001f-460b-4f9b-abf4-a6059919fc37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:19.030923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2040001f-460b-4f9b-abf4-a6059919fc37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:19.036936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2040001f-460b-4f9b-abf4-a6059919fc37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:19.037389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2040001f-460b-4f9b-abf4-a6059919fc37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:19.038147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2040001f-460b-4f9b-abf4-a6059919fc37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:19.038583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2040001f-460b-4f9b-abf4-a6059919fc37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:19.067881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2040001f-460b-4f9b-abf4-a6059919fc37 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042283 Jul 20 13:57:19.068459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 584/1189] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:57:19.908750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:19.909364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:19.915970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:19.916459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:19.917238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:19.917676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:20.048602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:20.056035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-75da0c8b-2ef5-4e09-9e35-23ffd236c9e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151204 Jul 20 13:57:20.056631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 585/1190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:20.078748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4b9f80c9-1ed0-48da-b319-0a549de21c5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:20.079685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4b9f80c9-1ed0-48da-b319-0a549de21c5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:20.085393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9f80c9-1ed0-48da-b319-0a549de21c5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:20.085843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9f80c9-1ed0-48da-b319-0a549de21c5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:20.086608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9f80c9-1ed0-48da-b319-0a549de21c5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:20.087046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9f80c9-1ed0-48da-b319-0a549de21c5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:20.115391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4b9f80c9-1ed0-48da-b319-0a549de21c5f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040293 Jul 20 13:57:20.115928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 586/1191] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 13:57:21.074242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:21.074916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:21.081796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:21.082237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:21.083001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:21.083407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:21.212983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:21.220565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a912fd6d-1626-463d-8625-0126dceb14b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150453 Jul 20 13:57:21.221129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 587/1192] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:21.225653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e8b1eaa8-f590-4bf9-922a-a89a42e1d049 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:21.226545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e8b1eaa8-f590-4bf9-922a-a89a42e1d049 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:21.232050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8b1eaa8-f590-4bf9-922a-a89a42e1d049 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:21.232528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8b1eaa8-f590-4bf9-922a-a89a42e1d049 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:21.233288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8b1eaa8-f590-4bf9-922a-a89a42e1d049 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:21.233719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8b1eaa8-f590-4bf9-922a-a89a42e1d049 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:21.261436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e8b1eaa8-f590-4bf9-922a-a89a42e1d049 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039323 Jul 20 13:57:21.261952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 588/1193] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:22.237476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:22.238085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:22.244509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:22.244956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:22.245714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:22.246171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:22.376655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:22.384056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-19ddb67a-277d-4445-b395-fcce68a59b7c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150389 Jul 20 13:57:22.384660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 589/1194] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:22.389668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96739be8-a1c2-4160-8b79-26cc9fd7ed7d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:22.390564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96739be8-a1c2-4160-8b79-26cc9fd7ed7d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:22.396092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96739be8-a1c2-4160-8b79-26cc9fd7ed7d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:22.396563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96739be8-a1c2-4160-8b79-26cc9fd7ed7d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:22.397319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96739be8-a1c2-4160-8b79-26cc9fd7ed7d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:22.397753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96739be8-a1c2-4160-8b79-26cc9fd7ed7d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:22.426135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96739be8-a1c2-4160-8b79-26cc9fd7ed7d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040489 Jul 20 13:57:22.426790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 590/1195] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:23.402039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:23.402691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:23.409115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:23.409559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:23.410317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:23.410747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:23.539313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:23.547481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7c597ad4-ef36-441d-98f3-9127b63b9d29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149261 Jul 20 13:57:23.555907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 591/1196] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:23.555907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-22519cb8-fdb6-4662-b1b1-1f3a209291d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:23.555907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-22519cb8-fdb6-4662-b1b1-1f3a209291d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:23.559238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22519cb8-fdb6-4662-b1b1-1f3a209291d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:23.559681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22519cb8-fdb6-4662-b1b1-1f3a209291d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:23.560455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22519cb8-fdb6-4662-b1b1-1f3a209291d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:23.560883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22519cb8-fdb6-4662-b1b1-1f3a209291d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:23.590100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-22519cb8-fdb6-4662-b1b1-1f3a209291d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041046 Jul 20 13:57:23.590642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 592/1197] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:24.564329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:24.564939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:24.571258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:24.571699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:24.572484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:24.573175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:24.927479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:24.935403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8677e4a5-c641-4827-8c25-cb3678acbb58 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.374530 Jul 20 13:57:24.935966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 593/1198] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:24 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:24.940439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-291c3a7d-a710-4e18-94dc-f2f8be9d3567 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:24.941351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-291c3a7d-a710-4e18-94dc-f2f8be9d3567 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:24.946814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-291c3a7d-a710-4e18-94dc-f2f8be9d3567 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:24.947251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-291c3a7d-a710-4e18-94dc-f2f8be9d3567 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:24.948297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-291c3a7d-a710-4e18-94dc-f2f8be9d3567 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:24.948724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-291c3a7d-a710-4e18-94dc-f2f8be9d3567 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:24.976935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-291c3a7d-a710-4e18-94dc-f2f8be9d3567 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039969 Jul 20 13:57:24.977478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 594/1199] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:25.952244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:25.952884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:25.959224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:25.959676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:25.960458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:25.960891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:26.098117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:26.100295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:26.107165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5d98a2b5-702b-4e70-a3fd-c201a1555a29 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.158335 Jul 20 13:57:26.107732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 595/1200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:26.112258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f0e2c16-6f75-463d-a820-e6714a8b9732 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:26.113159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f0e2c16-6f75-463d-a820-e6714a8b9732 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:26.118827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f0e2c16-6f75-463d-a820-e6714a8b9732 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:26.119268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f0e2c16-6f75-463d-a820-e6714a8b9732 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:26.120025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f0e2c16-6f75-463d-a820-e6714a8b9732 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:26.120484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f0e2c16-6f75-463d-a820-e6714a8b9732 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:26.148647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f0e2c16-6f75-463d-a820-e6714a8b9732 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039869 Jul 20 13:57:26.149186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 596/1201] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:27.041187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=5 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:27.066616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=85 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:27.124911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:27.125484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:27.131881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:27.132360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:27.133118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:27.133550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:27.271109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:27.278451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cb624b9e-4a90-48a3-b3d1-7269a68e30e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.158002 Jul 20 13:57:27.279009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 597/1202] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:27.283470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2a2a4f5c-6a85-4363-8af6-584eb06d6252 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:27.284390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2a2a4f5c-6a85-4363-8af6-584eb06d6252 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:27.290019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a2a4f5c-6a85-4363-8af6-584eb06d6252 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:27.290370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a2a4f5c-6a85-4363-8af6-584eb06d6252 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:27.291120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a2a4f5c-6a85-4363-8af6-584eb06d6252 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:27.291544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a2a4f5c-6a85-4363-8af6-584eb06d6252 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:27.319295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2a2a4f5c-6a85-4363-8af6-584eb06d6252 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039321 Jul 20 13:57:27.319832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 598/1203] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:28.295495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:28.296154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:28.302664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:28.303146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:28.303911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:28.304381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:28.431382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:28.438720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-529fc086-a65d-4ffd-946f-ca4d2c25967b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147280 Jul 20 13:57:28.439304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 599/1204] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:28.443853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f21dd230-16f7-4c3a-8b4c-ac289059fbc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:28.444787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f21dd230-16f7-4c3a-8b4c-ac289059fbc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:28.451198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f21dd230-16f7-4c3a-8b4c-ac289059fbc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:28.451687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f21dd230-16f7-4c3a-8b4c-ac289059fbc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:28.452468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f21dd230-16f7-4c3a-8b4c-ac289059fbc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:28.452898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f21dd230-16f7-4c3a-8b4c-ac289059fbc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:28.482995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f21dd230-16f7-4c3a-8b4c-ac289059fbc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042635 Jul 20 13:57:28.483466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 600/1205] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:29.456734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:29.457406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:29.463855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:29.464344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:29.465104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:29.465536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:29.593331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:29.600950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-07e1bd19-1b98-4699-bcd5-c7d5408e341f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148181 Jul 20 13:57:29.601545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 601/1206] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:29.606472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e69f5380-6a27-4261-b80c-1417bdaba472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:29.607370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e69f5380-6a27-4261-b80c-1417bdaba472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:29.612985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e69f5380-6a27-4261-b80c-1417bdaba472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:29.613440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e69f5380-6a27-4261-b80c-1417bdaba472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:29.614279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e69f5380-6a27-4261-b80c-1417bdaba472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:29.614716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e69f5380-6a27-4261-b80c-1417bdaba472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:29.643827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e69f5380-6a27-4261-b80c-1417bdaba472 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041273 Jul 20 13:57:29.644418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 602/1207] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:30.618157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:30.618797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:30.625135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:30.625579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:30.626341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:30.626771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:30.759195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:30.770090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a4ff7daa-7ce9-45e6-8ab1-b6a18bcaf3ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155874 Jul 20 13:57:30.770665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 603/1208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:30.775248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d5adba8e-e8ec-4fab-bdf0-e15d20d685f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:30.776155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d5adba8e-e8ec-4fab-bdf0-e15d20d685f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:30.781799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5adba8e-e8ec-4fab-bdf0-e15d20d685f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:30.782247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5adba8e-e8ec-4fab-bdf0-e15d20d685f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:30.783008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5adba8e-e8ec-4fab-bdf0-e15d20d685f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:30.783444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5adba8e-e8ec-4fab-bdf0-e15d20d685f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:30.811749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d5adba8e-e8ec-4fab-bdf0-e15d20d685f6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040101 Jul 20 13:57:30.812308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 604/1209] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jul 20 13:57:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 13:57:31.787141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:31.787964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:31.795042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:31.795487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:31.796281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:31.796712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:31.925053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:31.932625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-088e550a-0ad8-4473-b2c2-aacff022ae16 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149310 Jul 20 13:57:31.933194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 605/1210] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:31.937655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bed36acc-2ced-44d8-9b3c-b157c5febf96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:57:31.938565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bed36acc-2ced-44d8-9b3c-b157c5febf96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:31.944065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bed36acc-2ced-44d8-9b3c-b157c5febf96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:31.944545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bed36acc-2ced-44d8-9b3c-b157c5febf96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:31.945314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bed36acc-2ced-44d8-9b3c-b157c5febf96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:31.945748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bed36acc-2ced-44d8-9b3c-b157c5febf96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:32.023781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bed36acc-2ced-44d8-9b3c-b157c5febf96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/action" status: 200 len: 37806 microversion: 2.20 time: 0.089392 Jul 20 13:57:32.024429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 606/1211] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jul 20 13:57:31 2022] POST /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791/action => generated 37806 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:57:32.950381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:32.951102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:32.958123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:32.958571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:32.959334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:32.959788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:33.093767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:33.101272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fbbb3043-95fe-4806-b04d-7589555ae93a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155479 Jul 20 13:57:33.101835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 607/1212] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:34.118889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:34.119551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:34.126467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:34.126909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:34.127666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:34.128093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:34.257276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:34.265255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-26103100-2bc2-4c7b-9c19-dea150d19f20 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150290 Jul 20 13:57:34.265816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 608/1213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:34.679428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:57:34.679874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 13:57:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e (ip 10.222.0.17) !!! Jul 20 13:57:35.282152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:35.282666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:35.289207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:35.289665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:35.290433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:35.290867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:35.421784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:35.429241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b72261b6-4b7a-404d-9cc6-33eda3caa2b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151561 Jul 20 13:57:35.429834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 609/1214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:36.446114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:36.446705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:36.454489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:36.454938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:36.455709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:36.456170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:36.584816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:36.592785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c71bff82-ac88-4ed4-9e4c-cb3d185fe13c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150523 Jul 20 13:57:36.593350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 610/1215] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:37.610506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:37.611181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:37.617568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:37.617994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:37.618745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:37.619174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:37.747948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:37.755479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5bc3bf13-a644-43d2-a349-6130ce9dac84 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149544 Jul 20 13:57:37.756047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 611/1216] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:38.772805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:38.773444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:38.779769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:38.780234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:38.780988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:38.781415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:38.911656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:38.914014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:38.920896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7699e5ee-d5b1-48c6-8c2a-c96f684bdafd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151942 Jul 20 13:57:38.921458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 612/1217] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:39.938323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:39.938977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:39.945456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:39.945902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:39.946660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:39.947091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:40.075111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:40.082605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-16fa87d0-6a62-4cd3-82b4-1b16e8fd9e0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148406 Jul 20 13:57:40.083167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 613/1218] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:40.353808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0f3537a-f790-4812-9b5e-30e5a65e4e60 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:40.354734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e0f3537a-f790-4812-9b5e-30e5a65e4e60 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:40.360600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0f3537a-f790-4812-9b5e-30e5a65e4e60 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:40.361052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0f3537a-f790-4812-9b5e-30e5a65e4e60 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:40.361817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0f3537a-f790-4812-9b5e-30e5a65e4e60 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:40.362251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0f3537a-f790-4812-9b5e-30e5a65e4e60 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:40.390751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lazy-loading 'services' on Instance uuid 5c2c93bf-5a33-4636-9cad-26c1f1464734 {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:57:40.395791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e0f3537a-f790-4812-9b5e-30e5a65e4e60 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Jul 20 13:57:40.399904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 614/1219] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:57:41.100347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:41.100990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:41.103215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=82 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:41.108989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.109427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.110171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.110625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.250639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:41.257964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b6b75e33-cb1d-4068-9f79-cfce60c1e5f0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.161515 Jul 20 13:57:41.258519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 615/1220] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:41.407212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-23974446-6dba-484f-bca4-b50df5df1e7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:41.408124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-23974446-6dba-484f-bca4-b50df5df1e7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:41.414153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23974446-6dba-484f-bca4-b50df5df1e7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.414619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23974446-6dba-484f-bca4-b50df5df1e7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.415368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23974446-6dba-484f-bca4-b50df5df1e7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.415791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23974446-6dba-484f-bca4-b50df5df1e7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.445333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-23974446-6dba-484f-bca4-b50df5df1e7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042374 Jul 20 13:57:41.446115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 616/1221] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:57:41.464857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:41.465348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:41.472170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.472555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.474072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.474072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.501724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 13:57:41.585564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bdc8faf7-465c-459e-8ec7-a168b456e3e5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "DELETE /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 204 len: 0 microversion: 2.1 time: 0.124014 Jul 20 13:57:41.590037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 617/1222] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:57:41 2022] DELETE /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:57:41.596925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:41.597630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:41.603927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.604561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.605332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:41.605785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:41.733881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:41.741715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f7bb1cf1-42bb-4e1e-ab9a-4645089209a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150481 Jul 20 13:57:41.742277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 618/1223] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:41 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:42.274818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:42.275435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:42.282024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:42.282474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:42.283246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:42.283999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:42.411156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:42.418677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8ce1c0ca-450f-4dc4-8b24-404045529fe7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.147702 Jul 20 13:57:42.419243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 619/1224] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:42.456881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2b4318f2-2f91-45f0-9fa9-ba52099d7f21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:42.457876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2b4318f2-2f91-45f0-9fa9-ba52099d7f21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:42.463687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b4318f2-2f91-45f0-9fa9-ba52099d7f21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:42.464136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b4318f2-2f91-45f0-9fa9-ba52099d7f21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:42.464925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b4318f2-2f91-45f0-9fa9-ba52099d7f21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:42.465357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b4318f2-2f91-45f0-9fa9-ba52099d7f21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:42.495734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2b4318f2-2f91-45f0-9fa9-ba52099d7f21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Jul 20 13:57:42.496226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 620/1225] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 13:57:42.758813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:42.759351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:42.765363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:42.765809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:42.766567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:42.766999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:42.913950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:42.922566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a929b394-224e-443a-8c11-ee042113f63c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.167696 Jul 20 13:57:42.923144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 621/1226] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:42 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:43.435995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:43.436704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:43.443117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:43.443565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:43.444363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:43.444801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:43.575598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:43.584114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-da560a57-46c3-4637-b350-f8032cb48814 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152142 Jul 20 13:57:43.584708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 622/1227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:43.589189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-777345b4-034a-4366-9bb4-66d9fa51d2e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:43.590124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-777345b4-034a-4366-9bb4-66d9fa51d2e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:43.595596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-777345b4-034a-4366-9bb4-66d9fa51d2e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:43.596044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-777345b4-034a-4366-9bb4-66d9fa51d2e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:43.596847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-777345b4-034a-4366-9bb4-66d9fa51d2e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:43.597280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-777345b4-034a-4366-9bb4-66d9fa51d2e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:43.626456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-777345b4-034a-4366-9bb4-66d9fa51d2e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040739 Jul 20 13:57:43.627020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 623/1228] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:43.940048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:43.940722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:43.946713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:43.947163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:43.947922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:43.948651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:44.077095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:44.085027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-52df14b1-cfec-40c6-b288-0cce031fdf76 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149450 Jul 20 13:57:44.085595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 624/1229] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:43 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:44.601417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:44.602038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:44.609026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:44.609472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:44.610219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:44.610646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:44.738340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:44.745819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f255505b-a3f8-40b8-9920-38b6efb0eff1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148412 Jul 20 13:57:44.746388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 625/1230] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:44.751033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe66bde5-3778-457e-b668-a3d03a75ba41 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:44.751992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe66bde5-3778-457e-b668-a3d03a75ba41 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:44.757765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe66bde5-3778-457e-b668-a3d03a75ba41 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:44.758208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe66bde5-3778-457e-b668-a3d03a75ba41 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:44.758977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe66bde5-3778-457e-b668-a3d03a75ba41 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:44.759412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe66bde5-3778-457e-b668-a3d03a75ba41 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:44.788176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe66bde5-3778-457e-b668-a3d03a75ba41 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Jul 20 13:57:44.788734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 626/1231] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:45.101940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:45.102534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:45.108445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:45.108892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:45.109639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:45.110067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:45.239224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:45.241551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:45.248480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0d17fde1-efc6-48ed-ab24-8bb88a330c62 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150337 Jul 20 13:57:45.249537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 627/1232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:45 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:45.763360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:45.763989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:45.771569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:45.772009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:45.772798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:45.773230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:45.903187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:45.910705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f2b76ff9-f636-4d55-8a74-deacbac9b351 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151821 Jul 20 13:57:45.911273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 628/1233] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:45.915938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-324b2e8f-035c-4993-8c24-47e7b0f644d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:45.916874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-324b2e8f-035c-4993-8c24-47e7b0f644d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:45.925623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-324b2e8f-035c-4993-8c24-47e7b0f644d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:45.926300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-324b2e8f-035c-4993-8c24-47e7b0f644d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:45.927476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-324b2e8f-035c-4993-8c24-47e7b0f644d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:45.928146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-324b2e8f-035c-4993-8c24-47e7b0f644d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:45.969079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-324b2e8f-035c-4993-8c24-47e7b0f644d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056570 Jul 20 13:57:45.969892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 629/1234] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:46.265994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:46.266597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:46.272624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:46.273074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:46.273848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:46.274287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:46.400072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:46.407883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e5d3197a-9177-4e66-a8a2-edaf84bd01e8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.145748 Jul 20 13:57:46.408478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 630/1235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:46 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:46.926758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:46.927396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:46.933888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:46.934337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:46.935105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:46.935541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:47.066525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:47.074549 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c4ec11ce-abe8-402b-94a9-83b4a1a440ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151639 Jul 20 13:57:47.075122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 631/1236] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:47.080099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9e5385d6-ff3d-4292-abbb-79c1304ec41c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:47.081031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9e5385d6-ff3d-4292-abbb-79c1304ec41c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:47.087041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e5385d6-ff3d-4292-abbb-79c1304ec41c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:47.087490 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e5385d6-ff3d-4292-abbb-79c1304ec41c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:47.088379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e5385d6-ff3d-4292-abbb-79c1304ec41c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:47.088819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e5385d6-ff3d-4292-abbb-79c1304ec41c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:47.118192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9e5385d6-ff3d-4292-abbb-79c1304ec41c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 Jul 20 13:57:47.118738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 632/1237] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:47.424744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:47.425354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:47.431546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:47.431996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:47.432797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:47.433238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:47.558843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:47.567185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6902e2b0-fe12-4db7-b6c3-45c65e622fe7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146290 Jul 20 13:57:47.567752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 633/1238] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:47 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:48.092216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:48.093458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:48.099835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:48.100343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:48.101118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:48.101557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:48.232261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:48.240149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-205ae7e9-dbc4-4f0d-b776-e44b66ccee2b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151836 Jul 20 13:57:48.240741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 634/1239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:48.245277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-229a616c-c4dc-4556-9584-2006bb715dc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:48.246133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-229a616c-c4dc-4556-9584-2006bb715dc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:48.251826 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-229a616c-c4dc-4556-9584-2006bb715dc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:48.252308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-229a616c-c4dc-4556-9584-2006bb715dc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:48.253073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-229a616c-c4dc-4556-9584-2006bb715dc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:48.253509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-229a616c-c4dc-4556-9584-2006bb715dc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:48.281750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-229a616c-c4dc-4556-9584-2006bb715dc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040034 Jul 20 13:57:48.282291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 635/1240] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:48.584381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:48.585025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:48.590996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:48.591448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:48.592241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:48.593301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:48.720707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:48.728542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-56901c03-8fbe-4a08-9d55-357530ca5d9f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148077 Jul 20 13:57:48.729104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 636/1241] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:48 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:49.257139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:49.257793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:49.264264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:49.264715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:49.265477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:49.265910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:49.397135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:49.404837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9c6940a8-56c5-48d3-98fd-b64f51ef157e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151640 Jul 20 13:57:49.405401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 637/1242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:49.409860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-984f0463-278f-45c8-9f1f-5f09f8f9f9fa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:49.410758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-984f0463-278f-45c8-9f1f-5f09f8f9f9fa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:49.416321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-984f0463-278f-45c8-9f1f-5f09f8f9f9fa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:49.416821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-984f0463-278f-45c8-9f1f-5f09f8f9f9fa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:49.417612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-984f0463-278f-45c8-9f1f-5f09f8f9f9fa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:49.418043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-984f0463-278f-45c8-9f1f-5f09f8f9f9fa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:49.450206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-984f0463-278f-45c8-9f1f-5f09f8f9f9fa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Jul 20 13:57:49.450947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 638/1243] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:49.745745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:49.746299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:49.752328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:49.752781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:49.753539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:49.753972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:49.884953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:49.893453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7a5c7dd4-3ad5-4c68-ad09-fbcb9a253e32 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151646 Jul 20 13:57:49.894032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 639/1244] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:49 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:50.395988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=4 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:50.421893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:50.422506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:50.429107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:50.429558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:50.430324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:50.430759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:50.559085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:50.567084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f518a227-f73b-4309-88c5-b289a9352c95 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149055 Jul 20 13:57:50.567655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 640/1245] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:50.572131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b7ef8c9f-665a-4467-8cc4-9b44935576e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:50.573089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b7ef8c9f-665a-4467-8cc4-9b44935576e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:50.579500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7ef8c9f-665a-4467-8cc4-9b44935576e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:50.579951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7ef8c9f-665a-4467-8cc4-9b44935576e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:50.580753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7ef8c9f-665a-4467-8cc4-9b44935576e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:50.581193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b7ef8c9f-665a-4467-8cc4-9b44935576e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:50.610612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b7ef8c9f-665a-4467-8cc4-9b44935576e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041961 Jul 20 13:57:50.611169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 641/1246] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:50.910503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:50.911117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:50.917222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:50.917672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:50.918439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:50.918875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:51.051232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:51.059129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-436b1ba2-f24b-4251-b202-cf9c5e5cd1c6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152543 Jul 20 13:57:51.059698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 642/1247] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:50 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:57:51.585326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:51.586021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:51.592452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:51.593433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:51.594192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:51.594616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:51.726569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:51.734173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6c8fb07e-1757-4c65-93ce-9b3d7a3eff51 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152702 Jul 20 13:57:51.734740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 643/1248] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:51.739357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6ee2a73a-5e44-4e06-bd43-bfdb1c752edf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:51.740286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6ee2a73a-5e44-4e06-bd43-bfdb1c752edf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:51.745864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee2a73a-5e44-4e06-bd43-bfdb1c752edf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:51.746313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee2a73a-5e44-4e06-bd43-bfdb1c752edf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:51.747079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee2a73a-5e44-4e06-bd43-bfdb1c752edf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:51.747532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ee2a73a-5e44-4e06-bd43-bfdb1c752edf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:51.761482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:51.777320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6ee2a73a-5e44-4e06-bd43-bfdb1c752edf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Jul 20 13:57:51.777882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 644/1249] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:52.076365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:52.077616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:52.083634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:52.084082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:52.084874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:52.085313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:52.215681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:52.224118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2b57c74d-f0cb-4c52-93dd-662d70bec1cc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151919 Jul 20 13:57:52.224717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 645/1250] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:52 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:52.752422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:52.753133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:52.759842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:52.760355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:52.761153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:52.761618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:52.891728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:52.899245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4ba13c08-ce56-456c-b7ca-39301174d3de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151781 Jul 20 13:57:52.899810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 646/1251] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:52.904319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-da0f84c7-6db7-46c2-979f-8666920ba15b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:52.905262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-da0f84c7-6db7-46c2-979f-8666920ba15b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:52.910967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da0f84c7-6db7-46c2-979f-8666920ba15b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:52.911380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da0f84c7-6db7-46c2-979f-8666920ba15b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:52.912145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da0f84c7-6db7-46c2-979f-8666920ba15b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:52.912611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da0f84c7-6db7-46c2-979f-8666920ba15b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:52.941627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-da0f84c7-6db7-46c2-979f-8666920ba15b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040800 Jul 20 13:57:52.942174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 647/1252] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:53.240983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:53.242528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:53.247561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:53.248009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:53.248810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:53.249953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:53.376559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:53.384416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c9fda216-51f3-4e0d-b6f4-ca93ded9cb87 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147349 Jul 20 13:57:53.384982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 648/1253] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:53 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:53.916143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:53.916790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:53.923226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:53.923672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:53.924468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:53.924902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:54.060612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:54.068071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-35439a17-a0bc-417e-a14e-f9931be8e04a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.155810 Jul 20 13:57:54.068674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 649/1254] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:54.073140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d959c4fb-835d-4241-8bc6-9380276f59fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:54.074294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d959c4fb-835d-4241-8bc6-9380276f59fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:54.079811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d959c4fb-835d-4241-8bc6-9380276f59fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:54.080302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d959c4fb-835d-4241-8bc6-9380276f59fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:54.081074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d959c4fb-835d-4241-8bc6-9380276f59fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:54.081511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d959c4fb-835d-4241-8bc6-9380276f59fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:54.110320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d959c4fb-835d-4241-8bc6-9380276f59fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040665 Jul 20 13:57:54.110868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 650/1255] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:54.401979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:54.402591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:54.409212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:54.409660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:54.410425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:54.410855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:54.536982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:54.544827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cc3e82ab-87d6-4dda-b108-7eaf53855f0a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146685 Jul 20 13:57:54.545390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 651/1256] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:54 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:55.085570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:55.086198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:55.092693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:55.093140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:55.093900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:55.094329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:55.224753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:55.232232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6b43521a-b035-455b-8344-5174a389e883 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150546 Jul 20 13:57:55.232798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 652/1257] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:55.237851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fd0514bb-e184-4583-940e-65eb6e8cd6f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:55.238746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fd0514bb-e184-4583-940e-65eb6e8cd6f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:55.244509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd0514bb-e184-4583-940e-65eb6e8cd6f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:55.244985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd0514bb-e184-4583-940e-65eb6e8cd6f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:55.245749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd0514bb-e184-4583-940e-65eb6e8cd6f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:55.246180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd0514bb-e184-4583-940e-65eb6e8cd6f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:55.274793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fd0514bb-e184-4583-940e-65eb6e8cd6f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040540 Jul 20 13:57:55.275341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 653/1258] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:55.561741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:55.562344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:55.568411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:55.568861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:55.569618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:55.570049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:55.695973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:55.704073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-35e7863d-9607-4dbd-b55b-38e6bcf91fdc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146176 Jul 20 13:57:55.704671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 654/1259] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:55 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:56.253454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:56.254059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:56.260574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:56.261016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:56.261760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:56.262186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:56.391535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:56.399061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5b77bc95-5dfe-4077-8b6f-6997cbaf509e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149995 Jul 20 13:57:56.399624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 655/1260] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:56.404139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eda33b53-d001-40e4-8ca8-a22e0cd1806f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:56.405087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eda33b53-d001-40e4-8ca8-a22e0cd1806f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:56.410621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eda33b53-d001-40e4-8ca8-a22e0cd1806f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:56.411063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eda33b53-d001-40e4-8ca8-a22e0cd1806f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:56.411822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eda33b53-d001-40e4-8ca8-a22e0cd1806f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:56.412283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eda33b53-d001-40e4-8ca8-a22e0cd1806f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:56.440262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eda33b53-d001-40e4-8ca8-a22e0cd1806f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039655 Jul 20 13:57:56.440797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 656/1261] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:56.720732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:56.721341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:56.727387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:56.727836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:56.728627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:56.729062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:56.858905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:56.867295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e0febef3-5c02-49b7-afd1-019160347589 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150474 Jul 20 13:57:56.867859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 657/1262] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:56 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:57.416335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:57.417009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:57.423432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:57.423894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:57.424664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:57.425096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:57.555307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:57.563453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-875cdc57-c926-4bc8-ba5b-ff827630cd18 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150464 Jul 20 13:57:57.564020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 658/1263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:57.568488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-476ebc77-97db-4ec8-9559-11cace1a9921 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:57.569392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-476ebc77-97db-4ec8-9559-11cace1a9921 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:57.575133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-476ebc77-97db-4ec8-9559-11cace1a9921 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:57.575576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-476ebc77-97db-4ec8-9559-11cace1a9921 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:57.576364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-476ebc77-97db-4ec8-9559-11cace1a9921 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:57.576798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-476ebc77-97db-4ec8-9559-11cace1a9921 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:57.604871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-476ebc77-97db-4ec8-9559-11cace1a9921 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039831 Jul 20 13:57:57.605424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 659/1264] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:57 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:57.884763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:57.885297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:57.891825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:57.892300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:57.893048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:57.893484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:58.024148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:58.032144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-486bedc1-4dde-47dc-bc63-956952a762a4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151242 Jul 20 13:57:58.032841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 660/1265] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:57 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:58.580837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:58.581462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:58.588263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:58.588713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:58.589476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:58.589907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:58.593862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:58.719750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:58.727440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-60fae5c5-2f7d-4251-9d69-8be20a3a2bc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150444 Jul 20 13:57:58.728016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 661/1266] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:58.732638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-749d3b7c-dade-470a-9186-fd04b8b15be3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:58.733538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-749d3b7c-dade-470a-9186-fd04b8b15be3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:58.735659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:58.741096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-749d3b7c-dade-470a-9186-fd04b8b15be3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:58.741548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-749d3b7c-dade-470a-9186-fd04b8b15be3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:58.742313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-749d3b7c-dade-470a-9186-fd04b8b15be3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:58.742745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-749d3b7c-dade-470a-9186-fd04b8b15be3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:58.772577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-749d3b7c-dade-470a-9186-fd04b8b15be3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Jul 20 13:57:58.773094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 662/1267] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:57:59.049196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:59.049730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:59.055581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:59.056034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:59.056908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:59.057371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:59.188078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:59.195872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-089ed924-4ecc-4f05-9aca-3f20b622d008 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150548 Jul 20 13:57:59.196475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 663/1268] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:59 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:59.744084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:59.744940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:59.752624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:59.753133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:59.753918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:59.754359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:59.883844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:57:59.891596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e4a868ee-909f-4e41-a05a-a3ba0c36b26a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151362 Jul 20 13:57:59.892320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 664/1269] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:57:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:57:59.898204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-64658bb7-1c70-4a06-8a4e-fb78d2e51304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:57:59.899111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-64658bb7-1c70-4a06-8a4e-fb78d2e51304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:57:59.904810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64658bb7-1c70-4a06-8a4e-fb78d2e51304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:59.905251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64658bb7-1c70-4a06-8a4e-fb78d2e51304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:59.906018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64658bb7-1c70-4a06-8a4e-fb78d2e51304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:57:59.906449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64658bb7-1c70-4a06-8a4e-fb78d2e51304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:57:59.935589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-64658bb7-1c70-4a06-8a4e-fb78d2e51304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Jul 20 13:57:59.936147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 665/1270] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:57:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:00.214004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:00.214526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:00.220846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:00.221290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:00.222040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:00.222470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:00.349198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:00.357045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7727bc1b-2a11-46e6-a4cf-81b990afcd8d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147260 Jul 20 13:58:00.357812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 666/1271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:00 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:00.908166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:00.908842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:00.915550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:00.915992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:00.916833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:00.917269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:01.050086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:01.057551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1e435d70-35b3-4c10-b7f7-0700f08180ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.153266 Jul 20 13:58:01.058111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 667/1272] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:01.062566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b55665a5-b955-4521-a9e4-8450611e14d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:01.063960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b55665a5-b955-4521-a9e4-8450611e14d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:01.069443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b55665a5-b955-4521-a9e4-8450611e14d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:01.069888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b55665a5-b955-4521-a9e4-8450611e14d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:01.070647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b55665a5-b955-4521-a9e4-8450611e14d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:01.071081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b55665a5-b955-4521-a9e4-8450611e14d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:01.101021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b55665a5-b955-4521-a9e4-8450611e14d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Jul 20 13:58:01.101564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 668/1273] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:01.374808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:01.375324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:01.381337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:01.381788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:01.382551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:01.382986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:01.508364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:01.516741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7e39c134-af3f-4cdd-82c4-ab708e98168e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.145309 Jul 20 13:58:01.517300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 669/1274] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:01 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:02.075715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:02.076409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:02.083298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:02.083737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:02.084524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:02.084956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:02.218283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:02.226299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-36ebb32b-6a25-44f8-9f6d-bcb81530a02d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154764 Jul 20 13:58:02.226865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 670/1275] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:02.231430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0c1186d-3a8b-441e-bfe5-b39a008c71b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:02.232349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e0c1186d-3a8b-441e-bfe5-b39a008c71b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:02.237932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0c1186d-3a8b-441e-bfe5-b39a008c71b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:02.238377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0c1186d-3a8b-441e-bfe5-b39a008c71b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:02.239141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0c1186d-3a8b-441e-bfe5-b39a008c71b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:02.239571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0c1186d-3a8b-441e-bfe5-b39a008c71b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:02.268505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e0c1186d-3a8b-441e-bfe5-b39a008c71b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040619 Jul 20 13:58:02.269054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 671/1276] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:02.533428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:02.534034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:02.540047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:02.540528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:02.541308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:02.541728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:02.669854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:02.678699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ce483d40-b9b0-4d7d-845a-406c9ea31d8c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149126 Jul 20 13:58:02.679268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 672/1277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:02 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:03.243325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:03.244058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:03.250436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:03.250885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:03.251655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:03.252093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:03.381143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:03.389284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6f733ff7-3f29-48d6-96a5-5eacb66659a2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149815 Jul 20 13:58:03.389853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 673/1278] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:03.394892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eb935cf0-65bd-474c-9362-ba3421943fa9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:03.395799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eb935cf0-65bd-474c-9362-ba3421943fa9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:03.401320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb935cf0-65bd-474c-9362-ba3421943fa9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:03.401772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb935cf0-65bd-474c-9362-ba3421943fa9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:03.402546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb935cf0-65bd-474c-9362-ba3421943fa9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:03.402981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb935cf0-65bd-474c-9362-ba3421943fa9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:03.431575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eb935cf0-65bd-474c-9362-ba3421943fa9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040748 Jul 20 13:58:03.432117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 674/1279] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:03.696485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:03.697094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:03.703977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:03.704459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:03.705227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:03.705668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:03.839835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:03.847842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7279c420-d044-4a39-89c8-f6c2d5e157a0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.155300 Jul 20 13:58:03.848523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 675/1280] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:03 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:04.407558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:04.408222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:04.414656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:04.415091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:04.415871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:04.416325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:04.545155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:04.552799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8b782d38-cfa9-465d-86f4-ce09b5f93939 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149778 Jul 20 13:58:04.553367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 676/1281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:04.557856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c227bfb7-49ad-4d82-bb49-7419a0e5d08d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:04.558763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c227bfb7-49ad-4d82-bb49-7419a0e5d08d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:04.564985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c227bfb7-49ad-4d82-bb49-7419a0e5d08d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:04.565433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c227bfb7-49ad-4d82-bb49-7419a0e5d08d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:04.566196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c227bfb7-49ad-4d82-bb49-7419a0e5d08d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:04.566633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c227bfb7-49ad-4d82-bb49-7419a0e5d08d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:04.591940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:58:04.597079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c227bfb7-49ad-4d82-bb49-7419a0e5d08d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Jul 20 13:58:04.597632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 677/1282] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:04 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:04.866937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:04.867456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:04.873353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:04.873798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:04.874544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:04.874977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:05.008830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:05.016707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a7ec7c97-c943-4e30-a367-7b1457fbe2ef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153831 Jul 20 13:58:05.017232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 678/1283] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:04 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:05.569916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:05.570579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:05.577240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:05.577679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:05.578428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:05.578854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:05.709009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:05.716442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2c1cb892-f0da-473c-994c-82cfd40db2ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150397 Jul 20 13:58:05.716989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 679/1284] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:05.722258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-354717a6-5cfc-4dd5-bf22-201cb29e49d2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:05.723183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-354717a6-5cfc-4dd5-bf22-201cb29e49d2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:05.729424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-354717a6-5cfc-4dd5-bf22-201cb29e49d2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:05.729941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-354717a6-5cfc-4dd5-bf22-201cb29e49d2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:05.730708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-354717a6-5cfc-4dd5-bf22-201cb29e49d2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:05.731139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-354717a6-5cfc-4dd5-bf22-201cb29e49d2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:05.760624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-354717a6-5cfc-4dd5-bf22-201cb29e49d2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042615 Jul 20 13:58:05.761176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 680/1285] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:06.033577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:06.034186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:06.040145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:06.040626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:06.041393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:06.041832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:06.169308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:06.177725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e273ad0f-a552-48e6-996e-8bfc2c4c7b75 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148076 Jul 20 13:58:06.178292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 681/1286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:06 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:06.733652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:06.734282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:06.740752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:06.741199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:06.741972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:06.742410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:06.871940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:06.879932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3c61c13f-8675-4296-a2d4-18f7e6ab9c57 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150187 Jul 20 13:58:06.880538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 682/1287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:06.885267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cc10a30b-4681-4f2a-8442-e01834732812 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:06.886148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cc10a30b-4681-4f2a-8442-e01834732812 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:06.892345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc10a30b-4681-4f2a-8442-e01834732812 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:06.892799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc10a30b-4681-4f2a-8442-e01834732812 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:06.893567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc10a30b-4681-4f2a-8442-e01834732812 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:06.894008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cc10a30b-4681-4f2a-8442-e01834732812 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:06.921749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cc10a30b-4681-4f2a-8442-e01834732812 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040232 Jul 20 13:58:06.922290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 683/1288] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:07.194640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:07.195240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:07.201310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:07.201749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:07.202498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:07.202923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:07.327789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:07.336153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-55bc03d2-e0fc-42d3-97f4-50e802014716 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.145194 Jul 20 13:58:07.336748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 684/1289] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:07 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:07.897182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:07.897841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:07.904569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:07.905014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:07.905775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:07.906205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:08.045557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:08.053631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-080fa587-29b2-4e5b-bf02-736fd440493e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.160390 Jul 20 13:58:08.054188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 685/1290] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:08.058735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4daed509-4822-4f3c-9d76-97221577c1d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:08.059628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4daed509-4822-4f3c-9d76-97221577c1d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:08.065946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4daed509-4822-4f3c-9d76-97221577c1d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:08.066386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4daed509-4822-4f3c-9d76-97221577c1d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:08.067139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4daed509-4822-4f3c-9d76-97221577c1d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:08.067571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4daed509-4822-4f3c-9d76-97221577c1d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:08.095750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4daed509-4822-4f3c-9d76-97221577c1d4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040597 Jul 20 13:58:08.096316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 686/1291] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:08.353741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:08.354342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:08.360273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:08.360714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:08.361572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:08.362007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:08.489422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:08.497263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9231fd1f-6ca5-4a31-8420-866ffd5d7e80 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147403 Jul 20 13:58:08.497816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 687/1292] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:08 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:09.071681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:09.072430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:09.079183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:09.079663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:09.080452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:09.080892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:09.210544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:09.218002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6b0f7656-e4a3-4c09-b077-1d8105e573a5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.150234 Jul 20 13:58:09.218565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 688/1293] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:09.223497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-289aefaf-71c3-42fc-bdad-e1a1661b8be8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:09.224451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-289aefaf-71c3-42fc-bdad-e1a1661b8be8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:09.229896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289aefaf-71c3-42fc-bdad-e1a1661b8be8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:09.230342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289aefaf-71c3-42fc-bdad-e1a1661b8be8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:09.231132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289aefaf-71c3-42fc-bdad-e1a1661b8be8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:09.231563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-289aefaf-71c3-42fc-bdad-e1a1661b8be8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:09.259688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-289aefaf-71c3-42fc-bdad-e1a1661b8be8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039654 Jul 20 13:58:09.260241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 689/1294] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:09.514738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:09.515370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:09.521471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:09.521917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:09.522673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:09.523117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:09.650521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:09.658499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-25aa570f-c2e8-4c49-862d-49b25ed73b7f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147646 Jul 20 13:58:09.659056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 690/1295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:09 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:10.235693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:10.236393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:10.242882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:10.243322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:10.244078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:10.244527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:10.374198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:10.382310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-31a19c77-ca3a-4511-b75f-d3774504d145 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.151374 Jul 20 13:58:10.382884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 691/1296] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:10.387417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e061909b-833d-4dd4-8bce-d0d883fcfeda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:10.388371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e061909b-833d-4dd4-8bce-d0d883fcfeda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:10.393986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e061909b-833d-4dd4-8bce-d0d883fcfeda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:10.394439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e061909b-833d-4dd4-8bce-d0d883fcfeda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:10.395199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e061909b-833d-4dd4-8bce-d0d883fcfeda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:10.395637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e061909b-833d-4dd4-8bce-d0d883fcfeda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:10.427456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e061909b-833d-4dd4-8bce-d0d883fcfeda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Jul 20 13:58:10.428009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 692/1297] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:10.675457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:10.676069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:10.682898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:10.683351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:10.684120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:10.684585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:10.813518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:10.821416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c0b81913-f2c2-4139-b321-1497ce909a52 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150514 Jul 20 13:58:10.821983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 693/1298] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:10 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:11.398882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:11.399562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:11.405985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:11.406422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:11.407197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:11.407621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:11.422222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:58:11.537257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:11.544643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-49974ff5-4f0e-473c-bcfe-056a52571413 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149582 Jul 20 13:58:11.545208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 694/1299] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:11.549716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aa0d8068-f1f5-494c-9eb9-d17f6b0f2a10 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:11.550624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aa0d8068-f1f5-494c-9eb9-d17f6b0f2a10 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:11.556286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa0d8068-f1f5-494c-9eb9-d17f6b0f2a10 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:11.556736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa0d8068-f1f5-494c-9eb9-d17f6b0f2a10 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:11.557503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa0d8068-f1f5-494c-9eb9-d17f6b0f2a10 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:11.557935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa0d8068-f1f5-494c-9eb9-d17f6b0f2a10 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:11.587423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aa0d8068-f1f5-494c-9eb9-d17f6b0f2a10 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041229 Jul 20 13:58:11.587976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 695/1300] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:11.838866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:11.839395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:11.845962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:11.846399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:11.847144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:11.847570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:11.977640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:11.985552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d9dc9e03-b332-41a9-8844-81b2183f0e9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150633 Jul 20 13:58:11.986113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 696/1301] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:11 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:12.561475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:12.562094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:12.568507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:12.568956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:12.569722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:12.570159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:12.699052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:12.707248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-21e75bb2-a5dd-4bee-b98e-fc4b27e96970 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.149799 Jul 20 13:58:12.707816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 697/1302] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:12.712489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d18f949b-12e5-4896-a6b3-65dc0875e566 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:12.713390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d18f949b-12e5-4896-a6b3-65dc0875e566 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:12.718878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d18f949b-12e5-4896-a6b3-65dc0875e566 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:12.719873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d18f949b-12e5-4896-a6b3-65dc0875e566 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:12.720700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d18f949b-12e5-4896-a6b3-65dc0875e566 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:12.721136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d18f949b-12e5-4896-a6b3-65dc0875e566 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:12.749260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d18f949b-12e5-4896-a6b3-65dc0875e566 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040442 Jul 20 13:58:12.749806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 698/1303] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:13.002910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:13.003547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:13.009631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:13.010077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:13.010837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:13.011272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:13.143980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:13.152035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-20883d65-06f9-4886-89c0-31a178ecabb3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153434 Jul 20 13:58:13.152631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 699/1304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:12 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:13.724034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:13.724726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:13.731155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:13.731601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:13.732390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:13.732819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:13.860955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:13.868421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0bc7da29-0fc3-4a3c-9c87-79fb278f5159 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.148235 Jul 20 13:58:13.868985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 700/1305] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:13.873432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f96d60df-2452-41e9-94d5-8b9e30096144 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:13.874352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f96d60df-2452-41e9-94d5-8b9e30096144 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:13.880542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f96d60df-2452-41e9-94d5-8b9e30096144 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:13.880987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f96d60df-2452-41e9-94d5-8b9e30096144 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:13.881749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f96d60df-2452-41e9-94d5-8b9e30096144 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:13.882177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f96d60df-2452-41e9-94d5-8b9e30096144 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:13.910358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f96d60df-2452-41e9-94d5-8b9e30096144 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040402 Jul 20 13:58:13.910912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 701/1306] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:14.169711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:14.170239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:14.176834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:14.177285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:14.178048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:14.178487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:14.304531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:14.312418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f5383af0-35dc-4dee-9190-f149b3cce8dc tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146670 Jul 20 13:58:14.313529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 702/1307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:14 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:14.886122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:14.886753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:14.893604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:14.894047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:14.894800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:14.895226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:15.036585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:15.044241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0517d615-ea27-4156-b132-11cb7fe3d8e1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.161951 Jul 20 13:58:15.044816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 703/1308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:15.049669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-20c39671-29f1-43ab-91c4-2677fa26b621 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:15.050578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-20c39671-29f1-43ab-91c4-2677fa26b621 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:15.056383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20c39671-29f1-43ab-91c4-2677fa26b621 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:15.056833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20c39671-29f1-43ab-91c4-2677fa26b621 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:15.057600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20c39671-29f1-43ab-91c4-2677fa26b621 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:15.058032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20c39671-29f1-43ab-91c4-2677fa26b621 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:15.089950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-20c39671-29f1-43ab-91c4-2677fa26b621 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Jul 20 13:58:15.090521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 704/1309] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:15.330212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:15.330812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:15.336926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:15.337373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:15.338167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:15.338601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:15.467054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:15.475024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b755040-6dc5-43f9-9786-4b08bb33cec8 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148687 Jul 20 13:58:15.475595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 705/1310] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:15 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:16.062031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:16.062701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:16.069169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:16.069617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:16.070380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:16.070812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:16.205416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:16.212917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7e47367a-e35a-42c6-90ec-a5e75b2e512f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.154783 Jul 20 13:58:16.213485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 706/1311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:16.217995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2f5ee60d-7180-4a78-bbe1-6b9c0f769bfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:16.218926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2f5ee60d-7180-4a78-bbe1-6b9c0f769bfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:16.225084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f5ee60d-7180-4a78-bbe1-6b9c0f769bfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:16.225532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f5ee60d-7180-4a78-bbe1-6b9c0f769bfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:16.226293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f5ee60d-7180-4a78-bbe1-6b9c0f769bfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:16.226725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2f5ee60d-7180-4a78-bbe1-6b9c0f769bfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:16.255315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2f5ee60d-7180-4a78-bbe1-6b9c0f769bfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040804 Jul 20 13:58:16.255869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 707/1312] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:58:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:58:16.492107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:16.492646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:16.498756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:16.499202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:16.499958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:16.500930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:16.629636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:58:16.637743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a4141123-02c8-487c-905f-047eadbaac9a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149546 Jul 20 13:58:16.638320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 708/1313] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:58:16 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:58:17.097545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:58:17.098238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:58:17.103985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:17.104548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:17.105308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:58:17.105738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:58:27.101349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=95 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:58:27.123184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=91 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:58:53.748364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:58:53.749008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 13:58:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e (ip 10.222.0.17) !!! Jul 20 13:58:54.269343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:58:54.269568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 13:58:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e (ip 10.222.0.17) !!! Jul 20 13:58:55.972971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 13:58:55.973525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 13:58:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e (ip 10.222.0.17) !!! Jul 20 13:59:17.211110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9224df6b-b111-4ef6-b8fd-72e8146db26b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e" status: 202 len: 0 microversion: 2.1 time: 120.177436 Jul 20 13:59:17.212113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 606/1314] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 13:57:17 2022] DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e => generated 0 bytes in 120179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 13:59:17.219677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:17.220814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:17.227929 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.228727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:17.230167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.230740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:17.351827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lazy-loading 'services' on Instance uuid 5c2c93bf-5a33-4636-9cad-26c1f1464734 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:59:17.381210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:17.389647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1eeb501e-a4ce-4f11-a59a-79452cc4f427 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.175444 Jul 20 13:59:17.390486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 607/1315] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:17.395666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-094f6a64-2569-443c-afb6-67ac9c7a4efb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:17.396688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-094f6a64-2569-443c-afb6-67ac9c7a4efb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:17.402452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-094f6a64-2569-443c-afb6-67ac9c7a4efb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.402903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-094f6a64-2569-443c-afb6-67ac9c7a4efb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:17.403664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-094f6a64-2569-443c-afb6-67ac9c7a4efb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.404094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-094f6a64-2569-443c-afb6-67ac9c7a4efb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:17.433011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-094f6a64-2569-443c-afb6-67ac9c7a4efb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041276 Jul 20 13:59:17.433544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 608/1316] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:17.437823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:17.438418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:17.444322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.444767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:17.445517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.445950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:17.577968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:17.585836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ba42c641-a4c9-4809-900e-abe5584fd1d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151276 Jul 20 13:59:17.586400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 609/1317] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:17 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:17.591059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:17.591547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:17.597203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.597651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:17.598905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:17.599340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:27.356805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=4 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:27.595602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=8 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:27.617815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:40.530201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Request method failure captured: Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e HTTP/1.1 Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2Aekm0YwPuu5Wm9Y-swc1i_u6kZE8mGOIUZlnmvNJAknBUpL0FjQ7xSvjO0jgH1fbzMzKYteFzmv2lLoHuue6gWIuX3CAK6pBoygiLYDiDnJ6AMNRV_iRzrd2QmL9WCAbpsjsJhRLY51hJlWA4z0xMYVg_hvGEpVUG_lOVGHr3aHwg8 Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 13:59:40.532484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}] Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: a3e5180dc37741919bc068f5e2302850 Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 13:59:40.533994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'server_id': '5c2c93bf-5a33-4636-9cad-26c1f1464734', 'id': 'e2c252c2-019e-4cb6-832e-3b3cb976175e'} Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 13:59:40.534870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 13:59:40.536063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:59:40.537359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:59:40.538429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) Jul 20 13:59:40.539572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 13:59:40.540740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c909eb1d-7772-4ed2-8ec2-9315f1c30e58) {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 13:59:40.540740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d681aa87-61bb-44af-bc4a-14c59b8d91a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e" status: 400 len: 269 microversion: 2.1 time: 83.441115 Jul 20 13:59:40.540740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 709/1318] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 13:58:17 2022] DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e => generated 269 bytes in 83442 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 13:59:40.541295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:40.541897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:40.548860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:40.549298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:40.550054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:40.550478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:40.580408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lazy-loading 'services' on Instance uuid 5c2c93bf-5a33-4636-9cad-26c1f1464734 {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 13:59:40.699397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:40.707150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7f187e5b-8eed-4dbf-b276-5b748f42aef3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.171838 Jul 20 13:59:40.707729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 710/1319] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:40.712298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5cf067c6-4336-4add-85b4-eeb0abc29914 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:40.713264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5cf067c6-4336-4add-85b4-eeb0abc29914 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:40.718769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cf067c6-4336-4add-85b4-eeb0abc29914 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:40.719220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cf067c6-4336-4add-85b4-eeb0abc29914 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:40.719989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cf067c6-4336-4add-85b4-eeb0abc29914 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:40.720449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5cf067c6-4336-4add-85b4-eeb0abc29914 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:40.749765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5cf067c6-4336-4add-85b4-eeb0abc29914 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040853 Jul 20 13:59:40.750241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 711/1320] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:40.755527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:40.756096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:40.762014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:40.762459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:40.763221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:40.763653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:40.892928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:40.900822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d184aa8b-665b-4864-9615-bcf741ae79f6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149646 Jul 20 13:59:40.901386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 712/1321] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:40 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:41.561284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:41.561903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:41.569042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.569610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.570674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.571185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.597186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 13:59:41.676435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c52c7917-44c4-4c89-9191-6ecbdab2a786 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "DELETE /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 204 len: 0 microversion: 2.1 time: 0.118709 Jul 20 13:59:41.677904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 713/1322] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 13:59:41 2022] DELETE /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 13:59:41.757584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-b15281c3-5ce1-458d-a945-9430bd3c8cfe req-170f7c1e-8836-489e-98e1-a758f0ed0f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f9c037-a55c-46c4-aae3-4929db5f0193", "tag": "f1fd1db3-83b1-4e8d-a486-5ac886455b89"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 13:59:41.765623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-b15281c3-5ce1-458d-a945-9430bd3c8cfe req-170f7c1e-8836-489e-98e1-a758f0ed0f82 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.766073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-b15281c3-5ce1-458d-a945-9430bd3c8cfe req-170f7c1e-8836-489e-98e1-a758f0ed0f82 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.777560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-b15281c3-5ce1-458d-a945-9430bd3c8cfe req-170f7c1e-8836-489e-98e1-a758f0ed0f82 service nova] Creating event network-changed:f1fd1db3-83b1-4e8d-a486-5ac886455b89 for instance 36f9c037-a55c-46c4-aae3-4929db5f0193 on hv-cinder-81914 Jul 20 13:59:41.782514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-b15281c3-5ce1-458d-a945-9430bd3c8cfe req-170f7c1e-8836-489e-98e1-a758f0ed0f82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103403 Jul 20 13:59:41.783169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 714/1323] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 13:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:41.788323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:41.789025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:41.795195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.795645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.796456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.796897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.928836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:41.936450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-efb6f404-a81f-4583-9927-31d51ddc2eaa tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1568 microversion: 2.1 time: 0.152034 Jul 20 13:59:41.937325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 715/1324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:41.942699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f20a39e3-25fa-4dc2-b64a-cafc2bd3c8e4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:41.944053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f20a39e3-25fa-4dc2-b64a-cafc2bd3c8e4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:41.951679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f20a39e3-25fa-4dc2-b64a-cafc2bd3c8e4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.952115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f20a39e3-25fa-4dc2-b64a-cafc2bd3c8e4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.953386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f20a39e3-25fa-4dc2-b64a-cafc2bd3c8e4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.953983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f20a39e3-25fa-4dc2-b64a-cafc2bd3c8e4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.984393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f20a39e3-25fa-4dc2-b64a-cafc2bd3c8e4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045802 Jul 20 13:59:41.987376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 716/1325] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:41.990088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:41.990689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:41.996531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.996978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:41.997737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:41.998167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:42.133467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:42.141963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-65f8cbe1-fab4-4e8a-b69a-501b982babce tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.156008 Jul 20 13:59:42.142896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 717/1326] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:41 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:42.955653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:42.956323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:42.962718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:42.963175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:42.963940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:42.964410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:43.096922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:43.105594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0004df29-7d4a-4f07-a08b-cd6130a7ff35 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154115 Jul 20 13:59:43.106152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 718/1327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:43.110828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6f1575df-0740-45fb-ba17-bb77543d33f9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:43.111720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6f1575df-0740-45fb-ba17-bb77543d33f9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:43.117803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f1575df-0740-45fb-ba17-bb77543d33f9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:43.118241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f1575df-0740-45fb-ba17-bb77543d33f9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:43.119010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f1575df-0740-45fb-ba17-bb77543d33f9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:43.119768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f1575df-0740-45fb-ba17-bb77543d33f9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:43.149576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6f1575df-0740-45fb-ba17-bb77543d33f9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Jul 20 13:59:43.150254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 719/1328] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:43.158670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:43.159268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:43.165683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:43.166119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:43.166873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:43.167299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:43.297293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:43.305688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-daf8d662-55fe-4557-9bc2-baf89df1bc25 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150758 Jul 20 13:59:43.306247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 720/1329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:43 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:44.122877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:44.123541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:44.130019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:44.130456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:44.131207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:44.131630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:44.259757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:44.267085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d4906a5a-d58f-406a-a3fd-cfea59641e2f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148094 Jul 20 13:59:44.267641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 721/1330] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:44.272872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8582e28b-03f4-4290-9a6d-6c40d23ee1cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:44.273774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8582e28b-03f4-4290-9a6d-6c40d23ee1cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:44.279305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8582e28b-03f4-4290-9a6d-6c40d23ee1cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:44.279745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8582e28b-03f4-4290-9a6d-6c40d23ee1cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:44.280522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8582e28b-03f4-4290-9a6d-6c40d23ee1cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:44.280945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8582e28b-03f4-4290-9a6d-6c40d23ee1cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:44.309269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8582e28b-03f4-4290-9a6d-6c40d23ee1cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040627 Jul 20 13:59:44.309853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 722/1331] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:44.321969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:44.322566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:44.328520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:44.328965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:44.329712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:44.330150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:44.455083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:44.463370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-86f88f0e-ca17-41de-a431-10dccb14d276 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.144917 Jul 20 13:59:44.463995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 723/1332] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:44 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:45.284465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:45.285137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:45.292023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:45.292502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:45.293267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:45.293702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:45.426135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:45.434211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1c714a13-3564-40ba-8a2c-4558b90bf6d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153672 Jul 20 13:59:45.434788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 724/1333] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:45.439264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f223dc84-38bd-4122-b160-dd19f09917d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:45.440213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f223dc84-38bd-4122-b160-dd19f09917d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:45.445973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f223dc84-38bd-4122-b160-dd19f09917d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:45.446449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f223dc84-38bd-4122-b160-dd19f09917d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:45.447215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f223dc84-38bd-4122-b160-dd19f09917d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:45.447649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f223dc84-38bd-4122-b160-dd19f09917d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:45.464325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:45.479484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f223dc84-38bd-4122-b160-dd19f09917d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Jul 20 13:59:45.480044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 725/1334] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:45.484485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:45.485086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:45.491371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:45.491819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:45.492604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:45.493034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:45.618531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:45.626443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2071bc68-adde-4f5f-9680-37b66e35ec83 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.145394 Jul 20 13:59:45.627009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 726/1335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:45 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:46.450222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:46.450834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:46.457557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:46.458500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:46.459272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:46.459708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:46.599730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:46.607175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-81921bf1-d34b-4f79-ab22-69d04e138117 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.160913 Jul 20 13:59:46.607733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 727/1336] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:46.612159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e82abb57-f10d-423b-8cd5-1c31c558852c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:46.613074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e82abb57-f10d-423b-8cd5-1c31c558852c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:46.618598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e82abb57-f10d-423b-8cd5-1c31c558852c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:46.619038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e82abb57-f10d-423b-8cd5-1c31c558852c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:46.619789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e82abb57-f10d-423b-8cd5-1c31c558852c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:46.620235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e82abb57-f10d-423b-8cd5-1c31c558852c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:46.649225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e82abb57-f10d-423b-8cd5-1c31c558852c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040429 Jul 20 13:59:46.652872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 728/1337] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:46.654166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:46.654771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:46.660570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:46.661625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:46.662515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:46.663047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:46.796930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:46.804811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef96fc30-8bd9-4e52-bed8-c137253eb17f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154100 Jul 20 13:59:46.805386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 729/1338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:46 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:47.624055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:47.624743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:47.630779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:47.631230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:47.632001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:47.632464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:47.763855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:47.771172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c478904b-59dd-44fc-9ea0-d676e5621343 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151249 Jul 20 13:59:47.771726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 730/1339] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:47.776131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-576a5379-e878-478f-858b-4ffcb9af7270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:47.777042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-576a5379-e878-478f-858b-4ffcb9af7270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:47.782730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-576a5379-e878-478f-858b-4ffcb9af7270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:47.783174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-576a5379-e878-478f-858b-4ffcb9af7270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:47.783972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-576a5379-e878-478f-858b-4ffcb9af7270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:47.784433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-576a5379-e878-478f-858b-4ffcb9af7270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:47.813303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-576a5379-e878-478f-858b-4ffcb9af7270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040593 Jul 20 13:59:47.813844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 731/1340] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:47.821839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:47.822430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:47.828160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:47.828633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:47.829381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:47.829813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:47.954538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:47.963142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0788451c-d5fd-4758-b10f-7b3685234285 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.144665 Jul 20 13:59:47.963712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 732/1341] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:47 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:48.787625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:48.788294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:48.794634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:48.795074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:48.795821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:48.796267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:48.925870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:48.933822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-694e6fc3-cd29-4ba7-af24-7907113056d3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150073 Jul 20 13:59:48.934394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 733/1342] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:48.938955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7dcbc856-e7fd-46f6-8ae0-254ba0115ece tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:48.939853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7dcbc856-e7fd-46f6-8ae0-254ba0115ece tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:48.946054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dcbc856-e7fd-46f6-8ae0-254ba0115ece tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:48.946503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dcbc856-e7fd-46f6-8ae0-254ba0115ece tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:48.947268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dcbc856-e7fd-46f6-8ae0-254ba0115ece tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:48.947709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dcbc856-e7fd-46f6-8ae0-254ba0115ece tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:48.975984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7dcbc856-e7fd-46f6-8ae0-254ba0115ece tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040550 Jul 20 13:59:48.976573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 734/1343] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:48.980897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:48.981493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:48.987054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:48.987507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:48.988294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:48.988731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:49.120463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:49.128320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-529d5df6-b9e9-4f9d-9dfc-a15f89ee7933 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150799 Jul 20 13:59:49.128887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 735/1344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:48 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:49.951353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:49.951995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:49.959194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:49.959632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:49.960409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:49.960836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:50.089107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:50.096425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a91804a2-8ee3-4804-ba92-0d1738b440fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148889 Jul 20 13:59:50.096994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 736/1345] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:50.101424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b4da3bc3-2d1a-4416-b867-c87c42eb7499 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:50.102319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b4da3bc3-2d1a-4416-b867-c87c42eb7499 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:50.107947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4da3bc3-2d1a-4416-b867-c87c42eb7499 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:50.108428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4da3bc3-2d1a-4416-b867-c87c42eb7499 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:50.109175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4da3bc3-2d1a-4416-b867-c87c42eb7499 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:50.109600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4da3bc3-2d1a-4416-b867-c87c42eb7499 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:50.140175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b4da3bc3-2d1a-4416-b867-c87c42eb7499 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042057 Jul 20 13:59:50.140761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 737/1346] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:50.145975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:50.146579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:50.152142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:50.152635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:50.153473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:50.153913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:50.282485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:50.290468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-73c20d8d-7479-42ae-9d5f-eefe2c54a1ad tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148726 Jul 20 13:59:50.291037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 738/1347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:50 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:50.584705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=4 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:51.114035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:51.114610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:51.121078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:51.121514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:51.122261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:51.122711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:51.252380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:51.259837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a9ab6756-c79d-4241-8139-221d9eae6ce3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149704 Jul 20 13:59:51.260428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 739/1348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:51.265010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-29165467-2047-4cb3-a100-b575b36673a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:51.265902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-29165467-2047-4cb3-a100-b575b36673a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:51.272022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-29165467-2047-4cb3-a100-b575b36673a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:51.272495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-29165467-2047-4cb3-a100-b575b36673a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:51.273258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-29165467-2047-4cb3-a100-b575b36673a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:51.273682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-29165467-2047-4cb3-a100-b575b36673a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:51.303987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-29165467-2047-4cb3-a100-b575b36673a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042534 Jul 20 13:59:51.304566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 740/1349] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:51.308980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:51.309572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:51.314968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:51.315409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:51.316164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:51.316617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:51.441626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:51.449968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1d4c9e28-8e2c-4c57-8f12-619b9e207b99 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.144439 Jul 20 13:59:51.450535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 741/1350] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:51 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:52.276918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:52.277570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:52.284178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:52.284652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:52.285414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:52.286351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:52.290179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:52.420421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:52.427849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ebcbe2c8-5a80-40ad-8b12-c83d1d05932a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154861 Jul 20 13:59:52.428435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 742/1351] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:52.433094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-236c4ebb-ccdc-42db-8b2a-332c9337552e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:52.433982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-236c4ebb-ccdc-42db-8b2a-332c9337552e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:52.439761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-236c4ebb-ccdc-42db-8b2a-332c9337552e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:52.440119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-236c4ebb-ccdc-42db-8b2a-332c9337552e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:52.440922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-236c4ebb-ccdc-42db-8b2a-332c9337552e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:52.441487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-236c4ebb-ccdc-42db-8b2a-332c9337552e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:52.471279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-236c4ebb-ccdc-42db-8b2a-332c9337552e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Jul 20 13:59:52.471830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 743/1352] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:52.476675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:52.477269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:52.482939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:52.483391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:52.484211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:52.484962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:52.612919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:52.621282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1ef7c87b-6234-46c4-a372-3581fb0b7455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148507 Jul 20 13:59:52.621855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 744/1353] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:52 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:53.445452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:53.446132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:53.452492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:53.453197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:53.453954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:53.454391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:53.588985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:53.596439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4d17e5e8-cd62-40a3-9858-988ec237736a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154921 Jul 20 13:59:53.597009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 745/1354] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:53.601485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e41c1563-a84b-4e03-b255-80a7b277df0f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:53.602382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e41c1563-a84b-4e03-b255-80a7b277df0f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:53.607923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e41c1563-a84b-4e03-b255-80a7b277df0f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:53.608407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e41c1563-a84b-4e03-b255-80a7b277df0f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:53.609168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e41c1563-a84b-4e03-b255-80a7b277df0f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:53.609628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e41c1563-a84b-4e03-b255-80a7b277df0f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:53.638837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e41c1563-a84b-4e03-b255-80a7b277df0f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040806 Jul 20 13:59:53.639402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 746/1355] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:53.643726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:53.644378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:53.650766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:53.651208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:53.651969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:53.652430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:53.775462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:53.783250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6069d908-0d0b-43f5-9497-0a8d776cab71 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.142928 Jul 20 13:59:53.783809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 747/1356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:53 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:54.613845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:54.615085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:54.621482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:54.621938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:54.622707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:54.623146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:54.764565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:54.772485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a01d90c5-a157-4382-8b8a-c9d37a2a2dbb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.162609 Jul 20 13:59:54.773057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 748/1357] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:54.777503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1a71ef8c-3ecb-41ca-bc1d-c28284548d4d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:54.778428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1a71ef8c-3ecb-41ca-bc1d-c28284548d4d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:54.785479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a71ef8c-3ecb-41ca-bc1d-c28284548d4d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:54.786738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a71ef8c-3ecb-41ca-bc1d-c28284548d4d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:54.787762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a71ef8c-3ecb-41ca-bc1d-c28284548d4d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:54.788218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a71ef8c-3ecb-41ca-bc1d-c28284548d4d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:54.817922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1a71ef8c-3ecb-41ca-bc1d-c28284548d4d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Jul 20 13:59:54.818460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 749/1358] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:54.822717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:54.823311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:54.829040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:54.829489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:54.830244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:54.830678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:54.967112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:54.979132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cccbfa80-4a9d-4c28-ae07-871494ff3178 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.159580 Jul 20 13:59:54.979938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 750/1359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:54 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 13:59:55.790056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:55.790753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:55.797079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:55.797518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:55.798270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:55.798698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:55.926441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:55.934081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7f472898-6e9f-4f28-8ec3-1267595da553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148452 Jul 20 13:59:55.934654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 751/1360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:55.939207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7dccea45-97d3-4ad2-ac5f-229e6af61598 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:55.940113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7dccea45-97d3-4ad2-ac5f-229e6af61598 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:55.946376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dccea45-97d3-4ad2-ac5f-229e6af61598 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:55.946825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dccea45-97d3-4ad2-ac5f-229e6af61598 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:55.947591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dccea45-97d3-4ad2-ac5f-229e6af61598 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:55.948068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7dccea45-97d3-4ad2-ac5f-229e6af61598 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:55.977398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7dccea45-97d3-4ad2-ac5f-229e6af61598 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Jul 20 13:59:55.977944 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 752/1361] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:55.995868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:55.996501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:56.002179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:56.002627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:56.003385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:56.003824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:56.133554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:56.141363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0584f352-053a-4713-9582-6b6a536d5627 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149010 Jul 20 13:59:56.141927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 753/1362] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:55 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:56.951620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:56.952326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:56.959714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:56.960018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:56.960817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:56.961257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:57.090760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:57.098454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d51320d9-da23-4aac-8477-b3bdbf2b9b9e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150942 Jul 20 13:59:57.099023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 754/1363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:57.104310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5e0bf9ca-26a8-48db-a764-837fcbfd6615 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:57.105231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5e0bf9ca-26a8-48db-a764-837fcbfd6615 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:57.112769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e0bf9ca-26a8-48db-a764-837fcbfd6615 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:57.113436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e0bf9ca-26a8-48db-a764-837fcbfd6615 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:57.114710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e0bf9ca-26a8-48db-a764-837fcbfd6615 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:57.115138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e0bf9ca-26a8-48db-a764-837fcbfd6615 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:57.145046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5e0bf9ca-26a8-48db-a764-837fcbfd6615 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Jul 20 13:59:57.145637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 755/1364] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:57 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:57.157832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:57.158470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:57.161529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:57.165043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:57.165516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:57.166288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:57.166721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:57.299757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:57.308430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0363338a-e6d8-4927-a2c9-2e43405955ba tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154405 Jul 20 13:59:57.308997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 756/1365] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:57 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:58.114804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:58.115505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:58.121978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:58.122417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:58.123166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:58.123590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:58.266788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:58.275162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28f3137d-f5f9-498a-876d-c92a2984c6c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.164219 Jul 20 13:59:58.275734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 757/1366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:58.280214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1a65f6bb-b813-4d84-ac37-84b48b54b349 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:58.281115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1a65f6bb-b813-4d84-ac37-84b48b54b349 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:58.286586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a65f6bb-b813-4d84-ac37-84b48b54b349 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:58.287035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a65f6bb-b813-4d84-ac37-84b48b54b349 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:58.288077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a65f6bb-b813-4d84-ac37-84b48b54b349 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:58.288545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1a65f6bb-b813-4d84-ac37-84b48b54b349 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:58.312951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:58.319000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1a65f6bb-b813-4d84-ac37-84b48b54b349 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Jul 20 13:59:58.319584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 758/1367] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:58.325521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:58.326148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:58.332528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:58.333525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:58.334311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:58.334774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:58.462214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:58.470176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8690076a-ba29-4aed-b7ab-a35e02cb90e1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148728 Jul 20 13:59:58.470736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 759/1368] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:58 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:59.292845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:59.293496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:59.300024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:59.300505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:59.301271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:59.301708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:59.431838 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:59.439205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6bccfe22-fa0f-4220-97d4-15152d1eab8d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150317 Jul 20 13:59:59.439789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 760/1369] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 13:59:59.445255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bb366e68-b88f-4e56-a732-8a4014c23be5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:59.446158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bb366e68-b88f-4e56-a732-8a4014c23be5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:59.451797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb366e68-b88f-4e56-a732-8a4014c23be5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:59.452266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb366e68-b88f-4e56-a732-8a4014c23be5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:59.453278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb366e68-b88f-4e56-a732-8a4014c23be5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:59.454036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb366e68-b88f-4e56-a732-8a4014c23be5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:59.484021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bb366e68-b88f-4e56-a732-8a4014c23be5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Jul 20 13:59:59.484610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 761/1370] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 13:59:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 13:59:59.489105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 13:59:59.489695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 13:59:59.495320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:59.495876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:59.496668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 13:59:59.497102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 13:59:59.635073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 13:59:59.643125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-663fa188-9de0-410f-8351-d96702a1e32f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.157529 Jul 20 13:59:59.643953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 762/1371] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 13:59:59 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:00:00.456794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:00.457462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:00.464634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:00.465084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:00.465857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:00.466293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:00.596978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:00.604481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b6e45cce-4448-466e-85f1-53b21b45fd75 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151834 Jul 20 14:00:00.605059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 763/1372] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:00.610169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ad1a6ce6-b704-4f78-a3cb-a4ecf11d2334 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:00.611082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ad1a6ce6-b704-4f78-a3cb-a4ecf11d2334 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:00.617121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ad1a6ce6-b704-4f78-a3cb-a4ecf11d2334 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:00.617576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ad1a6ce6-b704-4f78-a3cb-a4ecf11d2334 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:00.618349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ad1a6ce6-b704-4f78-a3cb-a4ecf11d2334 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:00.618790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ad1a6ce6-b704-4f78-a3cb-a4ecf11d2334 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:00.649942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ad1a6ce6-b704-4f78-a3cb-a4ecf11d2334 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043828 Jul 20 14:00:00.650522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 764/1373] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:00.660138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:00.660769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:00.666986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:00.667430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:00.668207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:00.668641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:00.793372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:00.801250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7a1979ed-34c1-4046-89a7-62c2173eef42 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.144624 Jul 20 14:00:00.802372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 765/1374] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:00 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:01.621867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:01.622631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:01.628991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:01.629435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:01.630319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:01.630756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:01.761004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:01.768492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-03f99fab-8676-4ebb-8a2d-749a80ceac42 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150579 Jul 20 14:00:01.769071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 766/1375] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:01.774119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6c20754d-56fc-4ebc-864f-d9482b41aff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:01.775054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6c20754d-56fc-4ebc-864f-d9482b41aff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:01.780717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c20754d-56fc-4ebc-864f-d9482b41aff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:01.781165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c20754d-56fc-4ebc-864f-d9482b41aff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:01.781931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c20754d-56fc-4ebc-864f-d9482b41aff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:01.782367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c20754d-56fc-4ebc-864f-d9482b41aff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:01.810734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6c20754d-56fc-4ebc-864f-d9482b41aff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040698 Jul 20 14:00:01.811278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 767/1376] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:01.818727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:01.819324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:01.824928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:01.825379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:01.826131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:01.826561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:01.950831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:01.959515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-484b75be-d50b-49ae-ae92-8aa7999338c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.144846 Jul 20 14:00:01.960065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 768/1377] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:01 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:02.868871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:02.869482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:02.875581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:02.876030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:02.876828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:02.877592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:03.006403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:03.014921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5a2ddb0b-0f3d-4d08-9624-bb7eb7906055 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.232946 Jul 20 14:00:03.015487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 769/1378] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:03.019945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-69a5c207-a27c-471f-9382-6d6c5f50efef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:03.021032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-69a5c207-a27c-471f-9382-6d6c5f50efef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:03.026536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69a5c207-a27c-471f-9382-6d6c5f50efef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:03.026990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69a5c207-a27c-471f-9382-6d6c5f50efef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:03.027725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69a5c207-a27c-471f-9382-6d6c5f50efef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:03.028179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69a5c207-a27c-471f-9382-6d6c5f50efef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:03.056907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-69a5c207-a27c-471f-9382-6d6c5f50efef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040445 Jul 20 14:00:03.060833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 770/1379] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:03.061803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:03.062392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:03.068928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:03.069380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:03.070147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:03.070585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:03.423816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:03.432488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a60de727-a7e8-4c2d-b083-ca3d58449fcf tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.374076 Jul 20 14:00:03.433048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 771/1380] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:03 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:00:04.031855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:04.032556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:04.039686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:04.040154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:04.040954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:04.041391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:04.168524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:04.175988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7524d3f6-f4b9-4c53-9256-db63fa5c7b37 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148088 Jul 20 14:00:04.176663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 772/1381] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:04.181308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1b6330ac-cc5d-465e-901c-104aa1babe35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:04.182313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1b6330ac-cc5d-465e-901c-104aa1babe35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:04.188089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b6330ac-cc5d-465e-901c-104aa1babe35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:04.188580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b6330ac-cc5d-465e-901c-104aa1babe35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:04.189378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b6330ac-cc5d-465e-901c-104aa1babe35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:04.189816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b6330ac-cc5d-465e-901c-104aa1babe35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:04.219902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1b6330ac-cc5d-465e-901c-104aa1babe35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Jul 20 14:00:04.220498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 773/1382] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:04 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:04.449485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:04.450119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:04.456414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:04.456858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:04.457614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:04.458047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:04.587345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:04.595199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4cd2077c-7fd9-42a2-ac4d-b29963823d79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149579 Jul 20 14:00:04.595763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 774/1383] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:04 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:05.193903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:05.194590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:05.201017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:05.201472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:05.202251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:05.202689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:05.220671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:00:05.329494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:05.337061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6c15e6aa-a1e9-4bfe-8d45-5b906fca55d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.147646 Jul 20 14:00:05.337630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 775/1384] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:05.342099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-60acb2ff-8f9e-48eb-8818-1724d5dd509a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:05.343004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-60acb2ff-8f9e-48eb-8818-1724d5dd509a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:05.348695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60acb2ff-8f9e-48eb-8818-1724d5dd509a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:05.349158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60acb2ff-8f9e-48eb-8818-1724d5dd509a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:05.349999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60acb2ff-8f9e-48eb-8818-1724d5dd509a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:05.350454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60acb2ff-8f9e-48eb-8818-1724d5dd509a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:05.384668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-60acb2ff-8f9e-48eb-8818-1724d5dd509a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045973 Jul 20 14:00:05.385249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 776/1385] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:05.612227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:05.612752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:05.619614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:05.620062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:05.620868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:05.621302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:05.751820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:05.759728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-486bfe18-e933-40c2-8305-be93cefbf297 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151420 Jul 20 14:00:05.760308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 777/1386] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:05 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:00:06.353914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:06.354514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:06.361417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:06.361865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:06.362630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:06.363065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:06.508597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:06.516067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-27135cd9-2f20-46b2-94cb-90073f131916 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.166173 Jul 20 14:00:06.516656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 778/1387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:06.521730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e633bfa2-5850-47f7-b3cf-3ecdc272594a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:06.522624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e633bfa2-5850-47f7-b3cf-3ecdc272594a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:06.528184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e633bfa2-5850-47f7-b3cf-3ecdc272594a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:06.528667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e633bfa2-5850-47f7-b3cf-3ecdc272594a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:06.529419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e633bfa2-5850-47f7-b3cf-3ecdc272594a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:06.529880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e633bfa2-5850-47f7-b3cf-3ecdc272594a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:06.557587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e633bfa2-5850-47f7-b3cf-3ecdc272594a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039934 Jul 20 14:00:06.558131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 779/1388] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:06.776432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:06.777037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:06.782966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:06.783413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:06.784170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:06.784635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:06.911805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:06.919805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c534324d-4d51-40c5-be09-31dbdd1ee5c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147260 Jul 20 14:00:06.920397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 780/1389] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:06 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:07.533629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:07.534284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:07.541513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:07.541960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:07.542722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:07.543151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:07.677746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:07.685178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4e117b35-8eec-4be7-a774-e44bb9ed173f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155427 Jul 20 14:00:07.685743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 781/1390] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:07.690168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bcddc56d-4a46-43ef-a59a-39b6ee982270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:07.691067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bcddc56d-4a46-43ef-a59a-39b6ee982270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:07.696533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcddc56d-4a46-43ef-a59a-39b6ee982270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:07.696981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcddc56d-4a46-43ef-a59a-39b6ee982270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:07.697739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcddc56d-4a46-43ef-a59a-39b6ee982270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:07.698176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcddc56d-4a46-43ef-a59a-39b6ee982270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:07.726701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bcddc56d-4a46-43ef-a59a-39b6ee982270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039989 Jul 20 14:00:07.727251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 782/1391] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:07.936527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:07.937140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:07.943058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:07.943516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:07.944306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:07.944746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:08.070703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:08.079215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-54b339b8-2d39-4b16-99d4-0149e9df4feb tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146801 Jul 20 14:00:08.079817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 783/1392] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:07 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:08.702996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:08.703891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:08.711007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:08.711451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:08.712233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:08.712670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:08.844486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:08.852113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a399632f-d1c7-47b2-af49-c3375f728368 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153075 Jul 20 14:00:08.852711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 784/1393] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:08.857210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9d0aa5c9-0dd8-4a1c-94ad-4c684099dd80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:08.858112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9d0aa5c9-0dd8-4a1c-94ad-4c684099dd80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:08.863604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d0aa5c9-0dd8-4a1c-94ad-4c684099dd80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:08.864121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d0aa5c9-0dd8-4a1c-94ad-4c684099dd80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:08.864940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d0aa5c9-0dd8-4a1c-94ad-4c684099dd80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:08.865379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d0aa5c9-0dd8-4a1c-94ad-4c684099dd80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:08.893847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9d0aa5c9-0dd8-4a1c-94ad-4c684099dd80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040167 Jul 20 14:00:08.894399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 785/1394] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:09.102840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:09.103474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:09.109449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:09.109903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:09.110662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:09.111099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:09.235426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:09.244041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1472c5dd-0c06-4983-bd4e-60a460424dae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.145096 Jul 20 14:00:09.244643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 786/1395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:09 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:09.869112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:09.869730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:09.876109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:09.876584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:09.877335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:09.877758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:10.009304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:10.016907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cee2bf90-9db2-45a9-98a9-b1b9586edefe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151459 Jul 20 14:00:10.017727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 787/1396] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:10.022660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef0ef6fc-88cf-4f60-bb36-1f6ed9b8f426 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:10.023551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef0ef6fc-88cf-4f60-bb36-1f6ed9b8f426 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:10.029030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef0ef6fc-88cf-4f60-bb36-1f6ed9b8f426 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:10.029473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef0ef6fc-88cf-4f60-bb36-1f6ed9b8f426 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:10.030253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef0ef6fc-88cf-4f60-bb36-1f6ed9b8f426 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:10.030680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef0ef6fc-88cf-4f60-bb36-1f6ed9b8f426 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:10.059465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef0ef6fc-88cf-4f60-bb36-1f6ed9b8f426 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040763 Jul 20 14:00:10.060004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 788/1397] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:10.260790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:10.261428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:10.267688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:10.268139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:10.268929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:10.269363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:10.399270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:10.407166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5c0849cd-ccf4-4546-9650-5be3905e047f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150156 Jul 20 14:00:10.407743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 789/1398] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:10 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:11.034889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:11.035577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:11.042215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:11.042666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:11.043432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:11.043865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:11.172710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:11.180625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d5801f5c-7bef-46c5-9df7-7283c06274bf tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149604 Jul 20 14:00:11.181195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 790/1399] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:11.185720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-83c1f3b1-810a-41e3-b39a-c193b6c70017 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:11.186608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-83c1f3b1-810a-41e3-b39a-c193b6c70017 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:11.192771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83c1f3b1-810a-41e3-b39a-c193b6c70017 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:11.193222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83c1f3b1-810a-41e3-b39a-c193b6c70017 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:11.193984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83c1f3b1-810a-41e3-b39a-c193b6c70017 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:11.194413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-83c1f3b1-810a-41e3-b39a-c193b6c70017 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:11.222517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-83c1f3b1-810a-41e3-b39a-c193b6c70017 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040349 Jul 20 14:00:11.223065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 791/1400] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:11.424591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:11.425199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:11.431589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:11.432040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:11.432855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:11.433291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:11.437234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:00:11.563442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:11.571732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-06933ed2-3e48-4369-b4bf-d7d76d441b12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150909 Jul 20 14:00:11.572326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 792/1401] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:11 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:12.197763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:12.198443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:12.205249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:12.205643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:12.206437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:12.206870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:12.334346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:12.341837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7f5363ac-c5c5-40a3-9fd8-b6fc5447a713 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.147937 Jul 20 14:00:12.342401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 793/1402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:12.347031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-72360b83-708a-40de-874a-a6bf798a8552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:12.348064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-72360b83-708a-40de-874a-a6bf798a8552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:12.353886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72360b83-708a-40de-874a-a6bf798a8552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:12.354334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72360b83-708a-40de-874a-a6bf798a8552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:12.355102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72360b83-708a-40de-874a-a6bf798a8552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:12.355537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72360b83-708a-40de-874a-a6bf798a8552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:12.384411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-72360b83-708a-40de-874a-a6bf798a8552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041015 Jul 20 14:00:12.384956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 794/1403] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:12.589279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:12.589906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:12.595781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:12.596244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:12.597004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:12.597433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:12.728534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:12.736265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9d55e435-e2c6-48b4-90be-1f51b2d0defd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150961 Jul 20 14:00:12.736823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 795/1404] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:12 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:13.358184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:13.358918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:13.365373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:13.365822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:13.366591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:13.367029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:13.502512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:13.510552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ff7c9928-4f72-40a5-928f-0de7c5a79a11 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.156221 Jul 20 14:00:13.511129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 796/1405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:13.515600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-39eb8a8c-d485-4bbd-ba92-3ea32cd07265 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:13.516524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-39eb8a8c-d485-4bbd-ba92-3ea32cd07265 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:13.522181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-39eb8a8c-d485-4bbd-ba92-3ea32cd07265 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:13.522636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-39eb8a8c-d485-4bbd-ba92-3ea32cd07265 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:13.523403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-39eb8a8c-d485-4bbd-ba92-3ea32cd07265 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:13.523840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-39eb8a8c-d485-4bbd-ba92-3ea32cd07265 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:13.552208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-39eb8a8c-d485-4bbd-ba92-3ea32cd07265 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039575 Jul 20 14:00:13.553495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 797/1406] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:13.753129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:13.753667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:13.760309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:13.760767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:13.761532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:13.761967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:13.887919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:13.895777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2c7305b6-4113-41ae-9b8c-423f429dc630 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146563 Jul 20 14:00:13.896375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 798/1407] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:13 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:14.527480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:14.528124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:14.534743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:14.535184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:14.536650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:14.537084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:14.669197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:14.677061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6d6d585c-160d-4e7d-9ce1-eb2dfedfa228 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153540 Jul 20 14:00:14.677628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 799/1408] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:14.682096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-74cc22a5-0037-4ae0-841b-b0046d23e695 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:14.683002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-74cc22a5-0037-4ae0-841b-b0046d23e695 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:14.688599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74cc22a5-0037-4ae0-841b-b0046d23e695 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:14.689050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74cc22a5-0037-4ae0-841b-b0046d23e695 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:14.689820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74cc22a5-0037-4ae0-841b-b0046d23e695 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:14.690259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74cc22a5-0037-4ae0-841b-b0046d23e695 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:14.719742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-74cc22a5-0037-4ae0-841b-b0046d23e695 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041143 Jul 20 14:00:14.720292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 800/1409] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:14.913011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:14.913619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:14.919669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:14.920119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:14.920911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:14.921343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:15.047023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:15.055385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7bfaae36-8cd7-475b-8c33-927835d89dd2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146353 Jul 20 14:00:15.055946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 801/1410] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:14 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:15.693106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:15.693732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:15.700137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:15.700608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:15.701360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:15.701789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:15.841880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:15.850046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-88b87ff2-7151-4fb8-8f7e-8bade32829d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.160786 Jul 20 14:00:15.850615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 802/1411] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:15.855186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8e5d7a83-29ef-4d48-a0d2-3855d48e92c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:15.856082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8e5d7a83-29ef-4d48-a0d2-3855d48e92c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:15.861827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e5d7a83-29ef-4d48-a0d2-3855d48e92c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:15.862277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e5d7a83-29ef-4d48-a0d2-3855d48e92c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:15.863032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e5d7a83-29ef-4d48-a0d2-3855d48e92c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:15.863464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e5d7a83-29ef-4d48-a0d2-3855d48e92c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:15.891184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8e5d7a83-29ef-4d48-a0d2-3855d48e92c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039597 Jul 20 14:00:15.891733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 803/1412] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:16.072724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:16.073331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:16.079448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:16.079892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:16.080679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:16.081109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:16.210410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:16.218232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aa2c0a1f-c3da-47ab-ba8f-92f5bae106ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149272 Jul 20 14:00:16.218799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 804/1413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:16 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:16.867532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:16.868178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:16.874594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:16.875040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:16.875803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:16.876262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:17.004345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:00:17.011850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-192286bf-c937-4db6-9710-f1521d49fa4d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148838 Jul 20 14:00:17.012448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 805/1414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:00:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:00:17.016868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6aad700a-73dc-4927-8347-ab6288460712 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:17.017766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6aad700a-73dc-4927-8347-ab6288460712 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:17.020312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:00:17.024315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6aad700a-73dc-4927-8347-ab6288460712 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:17.024764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6aad700a-73dc-4927-8347-ab6288460712 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:17.025524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6aad700a-73dc-4927-8347-ab6288460712 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:17.025955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6aad700a-73dc-4927-8347-ab6288460712 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:17.056749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6aad700a-73dc-4927-8347-ab6288460712 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Jul 20 14:00:17.057289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 806/1415] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:00:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:00:17.219378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:00:17.219823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:00:17.227761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:17.228218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:17.228993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:00:17.229427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:00:25.846642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:00:25.847238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e (ip 10.222.0.17) !!! Jul 20 14:00:27.225368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:00:27.250097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=92 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:01:17.489533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Request method failure captured: Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e HTTP/1.1 Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2Aekm0YwPuu5Wm9Y-swc1i_u6kZE8mGOIUZlnmvNJAknBUpL0FjQ7xSvjO0jgH1fbzMzKYteFzmv2lLoHuue6gWIuX3CAK6pBoygiLYDiDnJ6AMNRV_iRzrd2QmL9WCAbpsjsJhRLY51hJlWA4z0xMYVg_hvGEpVUG_lOVGHr3aHwg8 Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:01:17.491997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}] Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: a3e5180dc37741919bc068f5e2302850 Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 14:01:17.493653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'server_id': '5c2c93bf-5a33-4636-9cad-26c1f1464734', 'id': 'e2c252c2-019e-4cb6-832e-3b3cb976175e'} Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 14:01:17.494599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 14:01:17.496092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:17.497546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:01:17.498786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) Jul 20 14:01:17.500205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:17.501496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-222efb51-627c-4db0-a195-43b1efcfe757) {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:01:17.501496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5700ad61-138e-49ca-87ca-609b67881975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e" status: 400 len: 269 microversion: 2.1 time: 119.905926 Jul 20 14:01:17.501496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 610/1416] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 13:59:17 2022] DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e => generated 269 bytes in 119907 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 14:01:17.501496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:17.501856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:17.508435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.508878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:17.509631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.510056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:17.581111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lazy-loading 'services' on Instance uuid 5c2c93bf-5a33-4636-9cad-26c1f1464734 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 14:01:17.657826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:17.666027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0277e407-be6c-4897-a8ab-5cc24a4ac9b7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.171015 Jul 20 14:01:17.666584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 611/1417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:17 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:17.670953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:17.671543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:17.677062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.677510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:17.678264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.678696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:17.804601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:17.812858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c420905c-6e99-43ee-b543-c087e88a19f5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.145331 Jul 20 14:01:17.813407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 612/1418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:17.817872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a9846c6e-f392-4f30-bf23-258733409215 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:17.818848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a9846c6e-f392-4f30-bf23-258733409215 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:17.825062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9846c6e-f392-4f30-bf23-258733409215 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.825505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9846c6e-f392-4f30-bf23-258733409215 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:17.826267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9846c6e-f392-4f30-bf23-258733409215 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.826695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9846c6e-f392-4f30-bf23-258733409215 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:17.854922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a9846c6e-f392-4f30-bf23-258733409215 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040551 Jul 20 14:01:17.855458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 613/1419] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:17.861462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:17.861950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:17.867511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.867951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:17.868761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:17.869190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:27.586110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=4 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:01:27.865312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=8 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:01:27.887648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=22 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:01:40.686666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Request method failure captured: Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e HTTP/1.1 Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2Aekm0YwPuu5Wm9Y-swc1i_u6kZE8mGOIUZlnmvNJAknBUpL0FjQ7xSvjO0jgH1fbzMzKYteFzmv2lLoHuue6gWIuX3CAK6pBoygiLYDiDnJ6AMNRV_iRzrd2QmL9WCAbpsjsJhRLY51hJlWA4z0xMYVg_hvGEpVUG_lOVGHr3aHwg8 Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:01:40.688968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}] Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: a3e5180dc37741919bc068f5e2302850 Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 14:01:40.690383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'server_id': '5c2c93bf-5a33-4636-9cad-26c1f1464734', 'id': 'e2c252c2-019e-4cb6-832e-3b3cb976175e'} Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 14:01:40.691494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 14:01:40.692993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.696004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:01:40.697385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) Jul 20 14:01:40.698739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.700023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb87c1e5-6447-408f-bdb3-b9b89fee358b) {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:01:40.700023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-74939b6d-c061-4926-9799-d5b2d8f8338b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e" status: 400 len: 269 microversion: 2.1 time: 83.475297 Jul 20 14:01:40.700023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 807/1420] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 14:00:17 2022] DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e => generated 269 bytes in 83476 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 14:01:40.700023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:40.700416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:40.702775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:40.703311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:40.704072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:40.704528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:40.737634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lazy-loading 'services' on Instance uuid 5c2c93bf-5a33-4636-9cad-26c1f1464734 {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 14:01:40.807458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Request method failure captured: Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e HTTP/1.1 Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2Aekm0YwPuu5Wm9Y-swc1i_u6kZE8mGOIUZlnmvNJAknBUpL0FjQ7xSvjO0jgH1fbzMzKYteFzmv2lLoHuue6gWIuX3CAK6pBoygiLYDiDnJ6AMNRV_iRzrd2QmL9WCAbpsjsJhRLY51hJlWA4z0xMYVg_hvGEpVUG_lOVGHr3aHwg8 Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:01:40.810276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ddc6ae060994d16b13ff53e80813e83"}]}] Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 1ddc6ae060994d16b13ff53e80813e83 Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1681230262 Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: a3e5180dc37741919bc068f5e2302850 Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-VolumesSnapshotTestJSON-1681230262-project Jul 20 14:01:40.811728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'server_id': '5c2c93bf-5a33-4636-9cad-26c1f1464734', 'id': 'e2c252c2-019e-4cb6-832e-3b3cb976175e'} Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 14:01:40.812488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 14:01:40.813523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.814628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:01:40.815640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) Jul 20 14:01:40.818726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:01:40.821122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6916a73a-a79e-4122-b683-c17bc30bf64b) {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:01:40.821122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-21c7989a-1637-4211-80fd-7b447e6c678b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e" status: 400 len: 269 microversion: 2.1 time: 22.956534 Jul 20 14:01:40.821122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 614/1421] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 14:01:17 2022] DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734/os-volume_attachments/e2c252c2-019e-4cb6-832e-3b3cb976175e => generated 269 bytes in 22958 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 14:01:40.821122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:40.821883 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:40.828091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:40.829993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:40.831033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:40.831472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:40.846756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:40.855817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b5a93f40-72be-4f96-809b-25f55dcaa7d7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.163998 Jul 20 14:01:40.856683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 808/1422] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:40 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:40.861544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-674bbfed-ebd0-417f-8579-bf0d653fd0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:40.862759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-674bbfed-ebd0-417f-8579-bf0d653fd0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:40.870977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674bbfed-ebd0-417f-8579-bf0d653fd0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:40.871512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674bbfed-ebd0-417f-8579-bf0d653fd0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:40.872488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674bbfed-ebd0-417f-8579-bf0d653fd0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:40.872989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-674bbfed-ebd0-417f-8579-bf0d653fd0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:40.906997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-674bbfed-ebd0-417f-8579-bf0d653fd0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049054 Jul 20 14:01:40.907653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 809/1423] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:40.963511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:40.970941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-50077fc1-a988-402a-ba9f-dfc9f082e93f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.156089 Jul 20 14:01:40.971488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 615/1424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:41.873981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:41.874642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:41.881058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:41.881504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:41.882262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:41.882694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:41.918500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a761ba98-b336-48e0-87a1-ccd8acdd3c59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:41.920256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a761ba98-b336-48e0-87a1-ccd8acdd3c59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:41.926908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a761ba98-b336-48e0-87a1-ccd8acdd3c59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:41.927361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a761ba98-b336-48e0-87a1-ccd8acdd3c59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:41.928136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a761ba98-b336-48e0-87a1-ccd8acdd3c59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:41.928609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a761ba98-b336-48e0-87a1-ccd8acdd3c59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:41.958358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a761ba98-b336-48e0-87a1-ccd8acdd3c59 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Jul 20 14:01:41.958905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 616/1425] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:01:41.988850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:41.989449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:41.995405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:41.995846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:41.996633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:41.997091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:42.012364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:42.020904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28b60ae3-135f-4bb8-afe7-d9569f3920b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151286 Jul 20 14:01:42.021485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 810/1426] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:41 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:42.137886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:42.145456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4f34dbb5-bbb0-4cc9-8e11-ea7ecd4c3942 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.160346 Jul 20 14:01:42.146031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 617/1427] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:42.970639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4b8e2f1f-745e-4519-a1c3-b196d0482d05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:42.971616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4b8e2f1f-745e-4519-a1c3-b196d0482d05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:42.978018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b8e2f1f-745e-4519-a1c3-b196d0482d05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:42.978469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b8e2f1f-745e-4519-a1c3-b196d0482d05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:42.979242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b8e2f1f-745e-4519-a1c3-b196d0482d05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:42.979678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b8e2f1f-745e-4519-a1c3-b196d0482d05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:43.008228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4b8e2f1f-745e-4519-a1c3-b196d0482d05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042265 Jul 20 14:01:43.008765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 811/1428] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:43.038221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:43.038826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:43.045838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:43.046279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:43.047040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:43.047466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:43.163755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:43.164661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:43.172736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:43.173296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:43.174073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:43.174585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:43.177788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:43.186258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-69a3877d-f092-4722-87c5-6215d46df7b3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151809 Jul 20 14:01:43.187076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 618/1429] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:43 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:43.305836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:43.313239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ccd8c66f-e97f-4054-b9b5-9a5af1727d9d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154267 Jul 20 14:01:43.313802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 812/1430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:44.020419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5ea23d6e-93c2-4cf8-9071-7198bc36c514 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:44.021400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5ea23d6e-93c2-4cf8-9071-7198bc36c514 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:44.027440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ea23d6e-93c2-4cf8-9071-7198bc36c514 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:44.027886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ea23d6e-93c2-4cf8-9071-7198bc36c514 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:44.028680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ea23d6e-93c2-4cf8-9071-7198bc36c514 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:44.029116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5ea23d6e-93c2-4cf8-9071-7198bc36c514 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:44.057077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5ea23d6e-93c2-4cf8-9071-7198bc36c514 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040748 Jul 20 14:01:44.057660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 619/1431] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:01:44.202782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:44.203393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:44.210406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:44.210862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:44.211648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:44.212084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:44.329965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:44.330959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:44.337106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:44.337553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:44.338272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:44.338415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:44.338746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:44.346759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cd995a01-5e94-48f8-9b8c-1379138f2299 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147829 Jul 20 14:01:44.347321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 813/1432] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:44 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:44.470489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:44.478500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-412c9279-0d7d-4ab7-a136-7bd2fe3a8467 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.152916 Jul 20 14:01:44.479054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 620/1433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:45.069097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-048b316e-c586-4760-8fa4-4175000055b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:45.070078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-048b316e-c586-4760-8fa4-4175000055b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:45.076089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-048b316e-c586-4760-8fa4-4175000055b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:45.076565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-048b316e-c586-4760-8fa4-4175000055b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:45.077830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-048b316e-c586-4760-8fa4-4175000055b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:45.078265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-048b316e-c586-4760-8fa4-4175000055b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:45.106993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-048b316e-c586-4760-8fa4-4175000055b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042007 Jul 20 14:01:45.107544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 814/1434] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:45.363302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:45.363923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:45.370338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:45.370791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:45.371561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:45.372001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:45.495237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:45.495848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:45.500806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:45.503136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:45.503584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:45.504392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:45.505538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:45.509106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6197e2f1-6f8e-42c4-b583-23ef59b860f7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149691 Jul 20 14:01:45.509676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 621/1435] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:45 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:45.640255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:45.647812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1395a3cd-4002-4e59-ab31-9c16066f98de tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.156524 Jul 20 14:01:45.648407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 815/1436] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:46.119472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9e3b1f4c-6d5d-4ecf-90d2-7b68a48e4aee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:46.120432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9e3b1f4c-6d5d-4ecf-90d2-7b68a48e4aee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:46.126357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f4c-6d5d-4ecf-90d2-7b68a48e4aee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:46.126799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f4c-6d5d-4ecf-90d2-7b68a48e4aee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:46.127556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f4c-6d5d-4ecf-90d2-7b68a48e4aee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:46.127984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9e3b1f4c-6d5d-4ecf-90d2-7b68a48e4aee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:46.162869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9e3b1f4c-6d5d-4ecf-90d2-7b68a48e4aee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047831 Jul 20 14:01:46.163420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 622/1437] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:46.526223 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:46.526834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:46.533288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:46.533739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:46.534506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:46.534944 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:46.664231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:46.666788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:46.667426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:46.673125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef6a9e78-4b81-40cd-9666-f0dc332cd6f9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150882 Jul 20 14:01:46.673700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 816/1438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:46 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:46.680779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:46.680779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:46.680779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:46.680779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:46.809170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:46.817232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2d9673fb-9a7c-4571-baca-870d38ba958d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155663 Jul 20 14:01:46.817822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 623/1439] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:47.174789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-da40fdae-6491-403e-96c5-0212c6504db2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:47.175835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-da40fdae-6491-403e-96c5-0212c6504db2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:47.182044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da40fdae-6491-403e-96c5-0212c6504db2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:47.182495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da40fdae-6491-403e-96c5-0212c6504db2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:47.183257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da40fdae-6491-403e-96c5-0212c6504db2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:47.183692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da40fdae-6491-403e-96c5-0212c6504db2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:47.211732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-da40fdae-6491-403e-96c5-0212c6504db2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 Jul 20 14:01:47.212289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 817/1440] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:47.691533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:47.692144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:47.698679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:47.699134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:47.699913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:47.703106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:47.833629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:47.834280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:47.835158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:47.840532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:47.840991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:47.841774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:47.842206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:47.844204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-688f5f09-7109-4522-ac92-f2851b68ed41 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.156432 Jul 20 14:01:47.844793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 624/1441] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:47 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:47.971974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:47.979623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3c3c40e3-5abc-4bf7-83e6-3a002fbe022d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150241 Jul 20 14:01:47.980241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 818/1442] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:48.224077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7e6ed032-5dd1-4996-8818-c89813afbc56 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:48.224953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7e6ed032-5dd1-4996-8818-c89813afbc56 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:48.230958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e6ed032-5dd1-4996-8818-c89813afbc56 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:48.231402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e6ed032-5dd1-4996-8818-c89813afbc56 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:48.232159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e6ed032-5dd1-4996-8818-c89813afbc56 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:48.232615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e6ed032-5dd1-4996-8818-c89813afbc56 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:48.261765 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7e6ed032-5dd1-4996-8818-c89813afbc56 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Jul 20 14:01:48.262295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 625/1443] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:48.861001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:48.861543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:48.867941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:48.868431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:48.869199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:48.869637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:48.996720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:48.997491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:48.999836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:49.004759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:49.005272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:49.006036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:49.006461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:49.007884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-95c2fd35-a9bd-4f3d-92c5-d11a45ce2303 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150882 Jul 20 14:01:49.008680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 819/1444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:48 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:49.135520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:49.143686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-110fca50-f36a-4b05-b68d-b9f5563ca7ca tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151002 Jul 20 14:01:49.144331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 626/1445] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:49.272903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8f780c88-3821-4276-b7fa-c19e8ed1084c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:49.273937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8f780c88-3821-4276-b7fa-c19e8ed1084c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:49.279867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f780c88-3821-4276-b7fa-c19e8ed1084c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:49.280355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f780c88-3821-4276-b7fa-c19e8ed1084c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:49.281119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f780c88-3821-4276-b7fa-c19e8ed1084c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:49.281561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f780c88-3821-4276-b7fa-c19e8ed1084c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:49.309099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8f780c88-3821-4276-b7fa-c19e8ed1084c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040120 Jul 20 14:01:49.309634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 820/1446] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:50.024957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:50.025562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:50.032317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:50.032784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:50.033577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:50.034012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:50.161040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:50.161642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:50.165759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:50.168288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:50.168739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:50.169512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:50.169942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:50.173876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d320e990-1932-41de-80d9-79afa7fba00a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152781 Jul 20 14:01:50.174442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 627/1447] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:50 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:50.310898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:50.318976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17c24116-3f7c-4464-aac7-da43234da5c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.161886 Jul 20 14:01:50.319542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 821/1448] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:50.320885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f435b8e3-b893-4076-8b43-8f20a4fa6e27 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:50.321807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f435b8e3-b893-4076-8b43-8f20a4fa6e27 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:50.327722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f435b8e3-b893-4076-8b43-8f20a4fa6e27 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:50.328254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f435b8e3-b893-4076-8b43-8f20a4fa6e27 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:50.329054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f435b8e3-b893-4076-8b43-8f20a4fa6e27 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:50.329486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f435b8e3-b893-4076-8b43-8f20a4fa6e27 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:50.357370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f435b8e3-b893-4076-8b43-8f20a4fa6e27 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040363 Jul 20 14:01:50.357896 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 628/1449] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:01:51.191510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:51.192119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:51.198531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:51.198980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:51.199742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:51.200176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:51.329475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:51.334948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:51.335684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:51.338572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a4bacb3e-aa85-45cb-b62a-8c3cfc412a48 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150885 Jul 20 14:01:51.339138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 822/1450] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:51 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:51.342059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:51.342509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:51.343275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:51.343712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:51.368389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7799a5c8-44ff-4f68-8639-3b73f3906a84 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:51.369333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7799a5c8-44ff-4f68-8639-3b73f3906a84 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:51.375971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7799a5c8-44ff-4f68-8639-3b73f3906a84 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:51.376448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7799a5c8-44ff-4f68-8639-3b73f3906a84 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:51.377217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7799a5c8-44ff-4f68-8639-3b73f3906a84 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:51.377652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7799a5c8-44ff-4f68-8639-3b73f3906a84 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:51.406956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7799a5c8-44ff-4f68-8639-3b73f3906a84 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042524 Jul 20 14:01:51.407520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 823/1451] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:01:51.473028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:51.480702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6cf5557f-8cb9-4112-bf2d-3c514d8030bb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149815 Jul 20 14:01:51.481303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 629/1452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:52.355289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:52.356121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:52.362327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:52.362777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:52.363538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:52.363970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:52.381886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:01:52.418412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3170019a-722e-47e8-b969-da3a90ec1cae tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:52.419339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3170019a-722e-47e8-b969-da3a90ec1cae tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:52.425822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3170019a-722e-47e8-b969-da3a90ec1cae tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:52.426275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3170019a-722e-47e8-b969-da3a90ec1cae tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:52.427047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3170019a-722e-47e8-b969-da3a90ec1cae tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:52.427492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3170019a-722e-47e8-b969-da3a90ec1cae tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:52.451752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:01:52.457614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3170019a-722e-47e8-b969-da3a90ec1cae tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Jul 20 14:01:52.458762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 630/1453] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:01:52.495470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:52.500003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:52.500647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:52.503835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2189da8a-d359-471f-bf55-ab87714e6ef2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152410 Jul 20 14:01:52.504437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 824/1454] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:52 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:52.506774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:52.507222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:52.507984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:52.508446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:52.642481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:52.650235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c63ada06-2dde-477b-b604-eee612d0dca7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155011 Jul 20 14:01:52.650852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 631/1455] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:53.469091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9c589f2f-6262-453c-b5e2-c8a4b61666c9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:53.470011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9c589f2f-6262-453c-b5e2-c8a4b61666c9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:53.477021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c589f2f-6262-453c-b5e2-c8a4b61666c9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:53.477468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c589f2f-6262-453c-b5e2-c8a4b61666c9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:53.478227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c589f2f-6262-453c-b5e2-c8a4b61666c9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:53.478660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c589f2f-6262-453c-b5e2-c8a4b61666c9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:53.507589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9c589f2f-6262-453c-b5e2-c8a4b61666c9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042481 Jul 20 14:01:53.508129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 825/1456] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:53.521528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:53.522136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:53.528910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:53.529368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:53.530133 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:53.530568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:53.657702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:53.665538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8609a4d6-df49-4d32-96c9-e626df61fbdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148566 Jul 20 14:01:53.666093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 632/1457] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:53 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:53.666836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:53.667440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:53.673962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:53.674402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:53.675147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:53.675576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:53.805985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:53.813353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ac455e4a-bdd4-4e6d-ac7e-f6de2acad42a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150413 Jul 20 14:01:53.814518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 826/1458] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:54.519489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2c8d8ac0-2eff-4eea-b325-f5b6dbee6cec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:54.520473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2c8d8ac0-2eff-4eea-b325-f5b6dbee6cec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:54.526943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c8d8ac0-2eff-4eea-b325-f5b6dbee6cec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:54.527528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c8d8ac0-2eff-4eea-b325-f5b6dbee6cec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:54.528146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c8d8ac0-2eff-4eea-b325-f5b6dbee6cec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:54.528640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2c8d8ac0-2eff-4eea-b325-f5b6dbee6cec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:54.558683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2c8d8ac0-2eff-4eea-b325-f5b6dbee6cec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Jul 20 14:01:54.559235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 633/1459] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:54.682783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:54.683394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:54.690643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:54.691090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:54.691854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:54.692322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:54.820810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:54.828654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0f7fd917-29cb-429d-aee8-97bd48ced4b2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149728 Jul 20 14:01:54.829469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 827/1460] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:54 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:54.831478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:54.832084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:54.838902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:54.839697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:54.841089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:54.841888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:54.973215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:54.982383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-34198540-00cb-4318-b6f1-00c832a9d5f7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155509 Jul 20 14:01:54.982944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 634/1461] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:55.570329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1c7d3d31-0f92-44ad-902b-a8d287cd6154 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:55.571244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1c7d3d31-0f92-44ad-902b-a8d287cd6154 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:55.577284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c7d3d31-0f92-44ad-902b-a8d287cd6154 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:55.577729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c7d3d31-0f92-44ad-902b-a8d287cd6154 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:55.578483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c7d3d31-0f92-44ad-902b-a8d287cd6154 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:55.578912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c7d3d31-0f92-44ad-902b-a8d287cd6154 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:55.607812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1c7d3d31-0f92-44ad-902b-a8d287cd6154 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041613 Jul 20 14:01:55.608394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 828/1462] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:55.847626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:55.848144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:55.854610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:55.855060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:55.855826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:55.856293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:55.986796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:55.994787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-abb4a725-ae4c-4dc7-bc21-007f22a0fb29 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151529 Jul 20 14:01:55.995571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 635/1463] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:55 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:55.999770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:56.000413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:56.006710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:56.007159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:56.007922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:56.008382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:56.137740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:56.145322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ddeff014-fb93-4d67-8a40-5b23cbfc87dd tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149257 Jul 20 14:01:56.145886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 829/1464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:56.619718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-54adc4fe-36d0-420b-95c3-4a8d4bea90b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:56.620672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-54adc4fe-36d0-420b-95c3-4a8d4bea90b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:56.626744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-54adc4fe-36d0-420b-95c3-4a8d4bea90b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:56.627190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-54adc4fe-36d0-420b-95c3-4a8d4bea90b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:56.627953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-54adc4fe-36d0-420b-95c3-4a8d4bea90b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:56.628418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-54adc4fe-36d0-420b-95c3-4a8d4bea90b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:56.663803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-54adc4fe-36d0-420b-95c3-4a8d4bea90b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048020 Jul 20 14:01:56.664385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 636/1465] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:57.011797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:57.012449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:57.019439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:57.019887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:57.020678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:57.021117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:57.150697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:57.158664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e455b14f-a8bb-4110-b0e4-f8e50eef814c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150689 Jul 20 14:01:57.159284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 830/1466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:57 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:57.162319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:57.162959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:57.169385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:57.169851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:57.170639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:57.171070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:57.298953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:57.306279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-783fa175-ebcb-43e0-8e4b-c066ba8abba8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148604 Jul 20 14:01:57.306835 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 637/1467] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:57.674912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eae41c22-c4e0-4f03-87ed-31406f481026 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:57.675897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eae41c22-c4e0-4f03-87ed-31406f481026 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:57.681898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eae41c22-c4e0-4f03-87ed-31406f481026 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:57.682338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eae41c22-c4e0-4f03-87ed-31406f481026 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:57.683097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eae41c22-c4e0-4f03-87ed-31406f481026 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:57.683526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eae41c22-c4e0-4f03-87ed-31406f481026 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:57.712338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eae41c22-c4e0-4f03-87ed-31406f481026 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Jul 20 14:01:57.712880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 831/1468] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:57 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:58.176602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:58.177224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:58.183375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:58.183827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:58.184608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:58.185041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:58.315615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:58.322721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:58.323334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:58.323811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a69e843c-d42a-4840-a2ce-2a96bc83af57 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151674 Jul 20 14:01:58.324405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 638/1469] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:58 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:58.329774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:58.330229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:58.331333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:58.331829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:58.460750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:58.468294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-404d5d01-cf23-443e-b190-2be9157f7ac5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149333 Jul 20 14:01:58.468875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 832/1470] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:58.723626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-608e92ef-2ab1-4584-a50a-7a1bfd3c771e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:58.724489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-608e92ef-2ab1-4584-a50a-7a1bfd3c771e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:58.730498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-608e92ef-2ab1-4584-a50a-7a1bfd3c771e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:58.730934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-608e92ef-2ab1-4584-a50a-7a1bfd3c771e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:58.731776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-608e92ef-2ab1-4584-a50a-7a1bfd3c771e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:58.732236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-608e92ef-2ab1-4584-a50a-7a1bfd3c771e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:58.760683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-608e92ef-2ab1-4584-a50a-7a1bfd3c771e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041656 Jul 20 14:01:58.761212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 639/1471] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:01:59.340312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:59.340920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:59.348046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:59.348516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:59.349283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:59.349746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:59.484399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:59.486181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:59.486795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:59.493136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b0d370e1-4cbe-4c02-8fbb-eae4fee4d32d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.156724 Jul 20 14:01:59.493803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:59.493965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 833/1472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:59 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:01:59.494252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:59.495025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:59.495456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:59.624018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:01:59.631822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fe7e9141-f43e-4b2b-9c1d-445f926ca741 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149758 Jul 20 14:01:59.632408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 640/1473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:01:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:01:59.772702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b80d807-69ea-4201-a33c-aae5f5abe0bc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:01:59.773659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b80d807-69ea-4201-a33c-aae5f5abe0bc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:01:59.779934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b80d807-69ea-4201-a33c-aae5f5abe0bc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:59.780418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b80d807-69ea-4201-a33c-aae5f5abe0bc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:59.781185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b80d807-69ea-4201-a33c-aae5f5abe0bc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:01:59.781618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b80d807-69ea-4201-a33c-aae5f5abe0bc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:01:59.811190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b80d807-69ea-4201-a33c-aae5f5abe0bc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Jul 20 14:01:59.811740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 834/1474] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:01:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:00.510327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:00.510924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:00.517336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:00.517778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:00.518525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:00.518953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:00.649008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:00.649676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:00.650213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:00.656406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:00.656855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:00.656977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ed191bc3-9189-40b1-a2aa-52e77579d076 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150604 Jul 20 14:02:00.657526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 641/1475] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:00 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:00.657640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:00.658080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:00.786938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:00.794416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-97ed1b96-2c7e-4af6-83be-f67990171cd4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149303 Jul 20 14:02:00.794978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 835/1476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:00.822488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e64a86b6-6d0b-49c4-8c5a-09570ed7afc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:00.823407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e64a86b6-6d0b-49c4-8c5a-09570ed7afc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:00.829286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e64a86b6-6d0b-49c4-8c5a-09570ed7afc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:00.829754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e64a86b6-6d0b-49c4-8c5a-09570ed7afc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:00.830507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e64a86b6-6d0b-49c4-8c5a-09570ed7afc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:00.831684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e64a86b6-6d0b-49c4-8c5a-09570ed7afc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:00.859797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e64a86b6-6d0b-49c4-8c5a-09570ed7afc8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Jul 20 14:02:00.860358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 642/1477] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:01.674488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:01.675590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:01.682240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:01.682685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:01.683443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:01.683873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:01.810497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:01.811379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:01.811987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:01.818976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:01.819170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9e2021f1-3d65-4be7-8c42-6fa238906280 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148525 Jul 20 14:02:01.819420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:01.819656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 836/1478] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:01 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:01.820208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:01.820638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:01.871647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ac8b252c-9800-4fff-a5fa-cea9fcc2f970 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:01.872952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ac8b252c-9800-4fff-a5fa-cea9fcc2f970 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:01.878968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac8b252c-9800-4fff-a5fa-cea9fcc2f970 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:01.879418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac8b252c-9800-4fff-a5fa-cea9fcc2f970 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:01.880186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac8b252c-9800-4fff-a5fa-cea9fcc2f970 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:01.880639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac8b252c-9800-4fff-a5fa-cea9fcc2f970 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:01.910224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ac8b252c-9800-4fff-a5fa-cea9fcc2f970 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Jul 20 14:02:01.910784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 837/1479] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:02:01.950916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:01.958607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-01d0e95a-5373-4cb1-9fbf-e64344d23e97 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151152 Jul 20 14:02:01.959343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 643/1480] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:02.836658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:02.837282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:02.843804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:02.844298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:02.845065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:02.845502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:02.921640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f16af254-d06c-453c-86a4-1f0dcd484cf4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:02.922566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f16af254-d06c-453c-86a4-1f0dcd484cf4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:02.929955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16af254-d06c-453c-86a4-1f0dcd484cf4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:02.930703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16af254-d06c-453c-86a4-1f0dcd484cf4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:02.931147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16af254-d06c-453c-86a4-1f0dcd484cf4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:02.931607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f16af254-d06c-453c-86a4-1f0dcd484cf4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:02.961014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f16af254-d06c-453c-86a4-1f0dcd484cf4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043248 Jul 20 14:02:02.961572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 644/1481] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:02:02.975176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:02.975773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:02.981666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:02.982102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:02.982859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:02.983290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:02.984319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:02.992917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-af8e670b-a153-4f89-88fa-33b1a1885df4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.160140 Jul 20 14:02:02.993489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 838/1482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:02 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:03.110453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:03.117783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7004e5dd-0b10-433e-8c11-e4b489296e3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.146948 Jul 20 14:02:03.118338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 645/1483] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:03.973056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2a6eff3c-ea67-4f6d-9cbc-55eb56c69ffa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:03.973977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2a6eff3c-ea67-4f6d-9cbc-55eb56c69ffa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:03.980577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a6eff3c-ea67-4f6d-9cbc-55eb56c69ffa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:03.981027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a6eff3c-ea67-4f6d-9cbc-55eb56c69ffa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:03.981794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a6eff3c-ea67-4f6d-9cbc-55eb56c69ffa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:03.982228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a6eff3c-ea67-4f6d-9cbc-55eb56c69ffa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:04.009393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:04.010003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:04.010474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2a6eff3c-ea67-4f6d-9cbc-55eb56c69ffa tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041961 Jul 20 14:02:04.011042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 839/1484] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:04.016636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:04.017087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:04.017858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:04.018292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:04.134953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:04.135664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:04.141909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:04.142348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:04.143104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:04.144165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:04.150875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:04.158720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-98bdabe0-8f9d-439e-a0b7-94aeef0cd487 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153258 Jul 20 14:02:04.159358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 646/1485] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:04 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:04.291919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:04.299316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef109c8d-ef37-4fed-9f29-e8b966140ec9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.168199 Jul 20 14:02:04.300569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 840/1486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:05.022751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-36f53cfe-e4c7-4d69-9644-0539abe45f0a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:05.023673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-36f53cfe-e4c7-4d69-9644-0539abe45f0a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:05.030402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f53cfe-e4c7-4d69-9644-0539abe45f0a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:05.030849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f53cfe-e4c7-4d69-9644-0539abe45f0a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:05.031616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f53cfe-e4c7-4d69-9644-0539abe45f0a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:05.032054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f53cfe-e4c7-4d69-9644-0539abe45f0a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:05.048141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:05.061415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-36f53cfe-e4c7-4d69-9644-0539abe45f0a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043265 Jul 20 14:02:05.061965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 647/1487] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:05.176135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:05.176783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:05.183335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:05.183787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:05.184585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:05.185021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:05.188867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:05.317047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:05.317193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:05.317830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:05.324031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:05.324512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:05.325182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-db288b42-0b12-4c7c-8f0a-73935666beef tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153054 Jul 20 14:02:05.325315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:05.325723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:05.325833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 841/1488] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:05 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:05.452916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:05.460560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-679ca791-d1eb-4a9f-abf5-3382c50e3fc9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148162 Jul 20 14:02:05.461115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 648/1489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:06.073131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1ea834f6-599a-4019-a22b-57796215ac37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:06.074064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1ea834f6-599a-4019-a22b-57796215ac37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:06.080126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ea834f6-599a-4019-a22b-57796215ac37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:06.080607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ea834f6-599a-4019-a22b-57796215ac37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:06.081888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ea834f6-599a-4019-a22b-57796215ac37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:06.082320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ea834f6-599a-4019-a22b-57796215ac37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:06.110714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1ea834f6-599a-4019-a22b-57796215ac37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Jul 20 14:02:06.111258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 842/1490] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:06.342556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:06.343095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:06.350075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:06.350516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:06.351264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:06.351698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:06.477627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:06.478292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:06.480945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:06.485027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:06.485478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:06.486246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:06.486678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:06.488861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-22867bf5-3fd7-4e71-b69e-ba81cefa2fbd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150274 Jul 20 14:02:06.489449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 649/1491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:06 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:06.616575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:06.623950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-04def281-e3b8-4905-9d47-58726da5a52f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150222 Jul 20 14:02:06.624571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 843/1492] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:07.122682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-908bb01c-5088-40b8-ae94-e3c34aa6d058 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:07.123611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-908bb01c-5088-40b8-ae94-e3c34aa6d058 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:07.129779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-908bb01c-5088-40b8-ae94-e3c34aa6d058 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:07.130228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-908bb01c-5088-40b8-ae94-e3c34aa6d058 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:07.130992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-908bb01c-5088-40b8-ae94-e3c34aa6d058 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:07.131427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-908bb01c-5088-40b8-ae94-e3c34aa6d058 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:07.161798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-908bb01c-5088-40b8-ae94-e3c34aa6d058 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Jul 20 14:02:07.162335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 650/1493] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:07.505961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:07.506563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:07.508833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=73 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:07.514209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:07.514652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:07.515414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:07.515842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:07.641911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:07.642524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:07.651894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:07.652458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:07.653173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:07.653615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:07.661745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:07.674331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-00f22d34-684b-40e1-a615-291969c8a8ed tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.172194 Jul 20 14:02:07.674913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 844/1494] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:07 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:07.784177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:07.792203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c6da0789-52ea-4863-ad61-3bc910cf3fe5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154201 Jul 20 14:02:07.792767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 651/1495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:08.173030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-32e584f1-298b-4582-a3a8-60e88b3ff405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:08.173934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-32e584f1-298b-4582-a3a8-60e88b3ff405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:08.180066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-32e584f1-298b-4582-a3a8-60e88b3ff405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:08.180538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-32e584f1-298b-4582-a3a8-60e88b3ff405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:08.181290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-32e584f1-298b-4582-a3a8-60e88b3ff405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:08.181715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-32e584f1-298b-4582-a3a8-60e88b3ff405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:08.210736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-32e584f1-298b-4582-a3a8-60e88b3ff405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Jul 20 14:02:08.211308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 845/1496] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:08.691304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:08.691946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:08.694590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=75 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:08.701132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:08.701587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:08.702491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:08.702934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:08.809072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:08.809686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:08.816067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:08.816547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:08.817319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:08.817754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:08.836289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:08.844878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7780c59c-a8ab-421c-9710-3f4eea76ad2c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.157534 Jul 20 14:02:08.854840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 652/1497] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:08 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:08.960680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:08.968076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9243fad8-18cd-481b-bb2f-be1cdc4b8bb0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.162848 Jul 20 14:02:08.968665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 846/1498] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:09.223034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ed2989a8-b729-48ae-a800-49ca863ea3ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:09.223946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ed2989a8-b729-48ae-a800-49ca863ea3ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:09.229968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed2989a8-b729-48ae-a800-49ca863ea3ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:09.230418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed2989a8-b729-48ae-a800-49ca863ea3ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:09.231183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed2989a8-b729-48ae-a800-49ca863ea3ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:09.231618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed2989a8-b729-48ae-a800-49ca863ea3ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:09.259267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ed2989a8-b729-48ae-a800-49ca863ea3ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040945 Jul 20 14:02:09.259803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 653/1499] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:09.862524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:09.863201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:09.869607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:09.870042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:09.870787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:09.871242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:09.985927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:09.986541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:09.992949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:09.993391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:09.994183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:09.994609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:09.997913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:10.005673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f4e2d64f-5d05-4435-9a5f-d57782703dd9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147098 Jul 20 14:02:10.006238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 847/1500] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:09 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:10.124659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:10.133247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e2eca75e-5638-4dae-a886-5af3e55a6b9f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151541 Jul 20 14:02:10.133866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 654/1501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:10.271472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f0fbfea2-4809-4fc4-a8d7-5bd209be0e79 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:10.272344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f0fbfea2-4809-4fc4-a8d7-5bd209be0e79 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:10.278218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0fbfea2-4809-4fc4-a8d7-5bd209be0e79 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:10.278669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0fbfea2-4809-4fc4-a8d7-5bd209be0e79 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:10.279423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0fbfea2-4809-4fc4-a8d7-5bd209be0e79 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:10.279854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0fbfea2-4809-4fc4-a8d7-5bd209be0e79 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:10.307497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f0fbfea2-4809-4fc4-a8d7-5bd209be0e79 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Jul 20 14:02:10.308038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 848/1502] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:11.022517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:11.023123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:11.029573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:11.030124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:11.030877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:11.031305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:11.150805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:11.151421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:11.157340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:11.157932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:11.158384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:11.159164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:11.159592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:11.165177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8c8715be-9437-4617-9121-9a784959d26e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147069 Jul 20 14:02:11.165943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 655/1503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:11 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:11.294027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:11.302002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-76bb6111-1158-434d-9757-fae11329ec83 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155019 Jul 20 14:02:11.302566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 849/1504] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:11.319455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9ff5703d-7641-423f-be39-190ab3f56662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:11.320415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9ff5703d-7641-423f-be39-190ab3f56662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:11.326282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ff5703d-7641-423f-be39-190ab3f56662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:11.326728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ff5703d-7641-423f-be39-190ab3f56662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:11.327487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ff5703d-7641-423f-be39-190ab3f56662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:11.327914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ff5703d-7641-423f-be39-190ab3f56662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:11.355777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9ff5703d-7641-423f-be39-190ab3f56662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040910 Jul 20 14:02:11.356336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 656/1505] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:12.182285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:12.182889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:12.189307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:12.189757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:12.190517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:12.190954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:12.316438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:12.318698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:12.319299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:12.324579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a311ef2d-1c73-4c69-a38e-f2c0837ede3d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146179 Jul 20 14:02:12.325251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 850/1506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:12 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:12.325606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:12.326047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:12.326804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:12.327229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:12.366964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cfcbfcbe-ee70-400b-a122-e606b2f5569a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:12.367873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cfcbfcbe-ee70-400b-a122-e606b2f5569a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:12.373792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfcbfcbe-ee70-400b-a122-e606b2f5569a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:12.374235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfcbfcbe-ee70-400b-a122-e606b2f5569a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:12.374992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfcbfcbe-ee70-400b-a122-e606b2f5569a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:12.375417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cfcbfcbe-ee70-400b-a122-e606b2f5569a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:12.405123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cfcbfcbe-ee70-400b-a122-e606b2f5569a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041913 Jul 20 14:02:12.405676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 851/1507] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:02:12.461560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:12.468908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eff14f0d-768a-4129-998b-4f6d82cf18d8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154007 Jul 20 14:02:12.469461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 657/1508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:13.341478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:13.342007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:13.348664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:13.349113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:13.349896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:13.350312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:13.415843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-18a1243d-522a-4e78-a889-5a835dd96482 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:13.416787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-18a1243d-522a-4e78-a889-5a835dd96482 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:13.423162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18a1243d-522a-4e78-a889-5a835dd96482 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:13.423607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18a1243d-522a-4e78-a889-5a835dd96482 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:13.424394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18a1243d-522a-4e78-a889-5a835dd96482 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:13.424830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18a1243d-522a-4e78-a889-5a835dd96482 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:13.454311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-18a1243d-522a-4e78-a889-5a835dd96482 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Jul 20 14:02:13.454906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 658/1509] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:02:13.485580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:13.486185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:13.486400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:13.492945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:13.493396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:13.494150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:13.494580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:13.494749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-49ad1543-70f4-414e-8bfc-c8655847d797 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.157173 Jul 20 14:02:13.495323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 852/1510] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:13 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:13.622288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:13.630345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6d6dd13c-4033-42aa-ad3e-1951b20f3f06 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148534 Jul 20 14:02:13.631146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 659/1511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:13.756472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:02:13.756668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:02:14.277272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:02:14.277499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:02:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:02:14.466619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ce09321a-668c-4cb3-83e3-9f19b6164233 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:14.467540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ce09321a-668c-4cb3-83e3-9f19b6164233 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:14.474730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce09321a-668c-4cb3-83e3-9f19b6164233 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:14.475177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce09321a-668c-4cb3-83e3-9f19b6164233 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:14.475939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce09321a-668c-4cb3-83e3-9f19b6164233 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:14.476403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce09321a-668c-4cb3-83e3-9f19b6164233 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:14.504818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ce09321a-668c-4cb3-83e3-9f19b6164233 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042463 Jul 20 14:02:14.505358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 853/1512] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:14.512079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:14.512843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:14.519889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:14.520370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:14.521140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:14.521578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:14.648050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:14.648703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:14.653392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:14.654712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:14.655154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:14.655917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:14.656379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:14.664268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2ab2f23e-820f-4722-9293-402334bb2354 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153215 Jul 20 14:02:14.664268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 660/1513] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:14 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:14.784367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:14.791663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0017c57f-4d94-4b2d-8898-51a24378bbd2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148759 Jul 20 14:02:14.792240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 854/1514] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:15.516211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-73649dd3-c3d6-4a60-a8cd-8d60ca51d5cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:15.517172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-73649dd3-c3d6-4a60-a8cd-8d60ca51d5cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:15.524313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73649dd3-c3d6-4a60-a8cd-8d60ca51d5cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:15.524774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73649dd3-c3d6-4a60-a8cd-8d60ca51d5cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:15.525519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73649dd3-c3d6-4a60-a8cd-8d60ca51d5cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:15.525950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73649dd3-c3d6-4a60-a8cd-8d60ca51d5cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:15.553673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-73649dd3-c3d6-4a60-a8cd-8d60ca51d5cf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041410 Jul 20 14:02:15.554210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 661/1515] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:15.677905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:15.678544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:15.685125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:15.685575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:15.686350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:15.686785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:15.808607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:15.809304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:15.812920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:15.815267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:15.815708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:15.816535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:15.816967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:15.821557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8445f348-1f9c-4ce1-93cc-d6593c9b7115 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147551 Jul 20 14:02:15.822144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 855/1516] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:15 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:15.945878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:15.953256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c23c88f-7c86-4920-b47d-48d6bb336c05 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.148465 Jul 20 14:02:15.954130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 662/1517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:15.981989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:02:15.982130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:02:16.749114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-67d76129-e24c-4557-bd0a-ae7cd7a66e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:16.750106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-67d76129-e24c-4557-bd0a-ae7cd7a66e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:16.756697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67d76129-e24c-4557-bd0a-ae7cd7a66e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:16.757137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67d76129-e24c-4557-bd0a-ae7cd7a66e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:16.757890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67d76129-e24c-4557-bd0a-ae7cd7a66e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:16.758316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67d76129-e24c-4557-bd0a-ae7cd7a66e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:16.785724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-67d76129-e24c-4557-bd0a-ae7cd7a66e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224208 Jul 20 14:02:16.786257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 856/1518] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:16.953536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:16.954149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:16.960530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:16.960976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:16.961737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:16.962166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:16.970165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:16.970764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:16.977691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:16.978135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:16.978914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:16.979338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:17.098151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:17.106291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-39e4ceb9-4a85-4922-9909-1d20069e5121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.271787 Jul 20 14:02:17.106866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 663/1519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:16 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:17.119308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:17.122680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:17.127848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-db7d18e3-88a6-4cb8-a8f5-3296a724a572 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.161493 Jul 20 14:02:17.128443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 857/1520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:17.797930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9438edd9-3da9-47f4-aa5a-16cde72b4a96 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:17.798905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9438edd9-3da9-47f4-aa5a-16cde72b4a96 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:17.805705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9438edd9-3da9-47f4-aa5a-16cde72b4a96 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:17.806149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9438edd9-3da9-47f4-aa5a-16cde72b4a96 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:17.806912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9438edd9-3da9-47f4-aa5a-16cde72b4a96 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:17.807348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9438edd9-3da9-47f4-aa5a-16cde72b4a96 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:17.810934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:17.836001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9438edd9-3da9-47f4-aa5a-16cde72b4a96 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Jul 20 14:02:17.836577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 664/1521] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:18.124613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:18.125232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:18.131908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:18.132398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:18.133171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:18.133609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:18.145256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:18.146005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:18.153661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:18.154112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:18.154883 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:18.155322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:18.266017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:18.274083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a8d66ba2-8567-4290-9dbd-0791223e0d0d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154058 Jul 20 14:02:18.274651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 858/1522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:18 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:18.296601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:18.304815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-57ddd8d8-62d1-4914-a162-e2345be772e8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.164100 Jul 20 14:02:18.305368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 665/1523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:18.847608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-01856034-702e-49d3-917a-aaf33ce6a6b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:18.848680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-01856034-702e-49d3-917a-aaf33ce6a6b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:18.855002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01856034-702e-49d3-917a-aaf33ce6a6b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:18.855454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01856034-702e-49d3-917a-aaf33ce6a6b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:18.856235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01856034-702e-49d3-917a-aaf33ce6a6b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:18.856676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01856034-702e-49d3-917a-aaf33ce6a6b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:18.885984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-01856034-702e-49d3-917a-aaf33ce6a6b9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042502 Jul 20 14:02:18.886570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 859/1524] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:18 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:19.291032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:19.291643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:19.298392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:19.298826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:19.299622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:19.300058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:19.322344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:19.322994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:19.329337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:19.329805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:19.330556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:19.330980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:19.433504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:19.441354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f3ab0c3a-6c0a-4b84-a47f-74ea5b333a79 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154251 Jul 20 14:02:19.441915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 666/1525] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:19 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:19.465381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:19.473594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-38ba60ac-12bc-40d7-a459-60c6f79520db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155062 Jul 20 14:02:19.474151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 860/1526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:19.897842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2801173b-4388-4bdc-bbc1-8d5de1984917 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:19.898954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2801173b-4388-4bdc-bbc1-8d5de1984917 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:19.904884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2801173b-4388-4bdc-bbc1-8d5de1984917 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:19.905321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2801173b-4388-4bdc-bbc1-8d5de1984917 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:19.906073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2801173b-4388-4bdc-bbc1-8d5de1984917 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:19.906498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2801173b-4388-4bdc-bbc1-8d5de1984917 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:19.935513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2801173b-4388-4bdc-bbc1-8d5de1984917 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 Jul 20 14:02:19.936047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 667/1527] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:20.458191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:20.458787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:20.465206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:20.465610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:20.466364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:20.466788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:20.491476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:20.492233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:20.498902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:20.499351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:20.500121 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:20.500586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:20.596219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:20.605520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2c740f7c-b66c-46e8-8129-a04816957816 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151483 Jul 20 14:02:20.606084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 861/1528] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:20 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:20.637527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:20.645110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b16502c8-473a-4608-9e98-3b89e9becedb tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.158399 Jul 20 14:02:20.645670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 668/1529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:20.946333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-61262e4e-1be5-4f2e-9153-c6911b158f3d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:20.947279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-61262e4e-1be5-4f2e-9153-c6911b158f3d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:20.953469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61262e4e-1be5-4f2e-9153-c6911b158f3d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:20.953926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61262e4e-1be5-4f2e-9153-c6911b158f3d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:20.954698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61262e4e-1be5-4f2e-9153-c6911b158f3d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:20.955133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61262e4e-1be5-4f2e-9153-c6911b158f3d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:20.985799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-61262e4e-1be5-4f2e-9153-c6911b158f3d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Jul 20 14:02:20.986370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 862/1530] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:20 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:21.622826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:21.623437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:21.629904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:21.630365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:21.631336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:21.631770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:21.662628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:21.663224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:21.669701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:21.670145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:21.670901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:21.671333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:21.767841 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:21.775939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bcd42c7d-0a0c-4926-9502-44a10b2dcbfa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.156948 Jul 20 14:02:21.776533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 669/1531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:21 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:21.802716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:21.810037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dfd87d99-0b52-4518-a9ef-b87afaf3e3b3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151739 Jul 20 14:02:21.810589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 863/1532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:21.997247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f467a744-46ea-484a-a8a3-210859e57275 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:21.998167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f467a744-46ea-484a-a8a3-210859e57275 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:22.004757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f467a744-46ea-484a-a8a3-210859e57275 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:22.005205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f467a744-46ea-484a-a8a3-210859e57275 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:22.005960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f467a744-46ea-484a-a8a3-210859e57275 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:22.006388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f467a744-46ea-484a-a8a3-210859e57275 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:22.034087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f467a744-46ea-484a-a8a3-210859e57275 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040757 Jul 20 14:02:22.034624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 670/1533] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:22.793261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:22.793859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:22.800440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:22.801457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:22.802257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:22.802668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:22.826784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:22.827392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:22.834439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:22.834886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:22.835650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:22.836082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:22.935723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:22.943637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-35869887-d8a4-4c39-83f3-c171bf4697e3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154174 Jul 20 14:02:22.944221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 864/1534] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:22 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:22.969781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:22.977886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5abd2eb0-571a-4739-9bf0-17c18ca67787 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154953 Jul 20 14:02:22.978443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 671/1535] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:23.045433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e353d5ec-db2e-40b0-a73d-23f853f9aa6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:23.046275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e353d5ec-db2e-40b0-a73d-23f853f9aa6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:23.053011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e353d5ec-db2e-40b0-a73d-23f853f9aa6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:23.053449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e353d5ec-db2e-40b0-a73d-23f853f9aa6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:23.054216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e353d5ec-db2e-40b0-a73d-23f853f9aa6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:23.054639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e353d5ec-db2e-40b0-a73d-23f853f9aa6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:23.101564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e353d5ec-db2e-40b0-a73d-23f853f9aa6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059956 Jul 20 14:02:23.102179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 865/1536] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:23.961455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:23.962070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:23.968583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:23.969027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:23.969786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:23.970219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:23.995170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:23.995781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:24.002260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:24.002707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:24.003480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:24.003916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:24.099556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:24.108020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-244b2898-aed0-4f2d-86c7-ac06d7ebbb4e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151303 Jul 20 14:02:24.108632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 672/1537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:23 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:24.113277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-98a3545f-9442-42af-ad43-8e96e04c5662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:24.114734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-98a3545f-9442-42af-ad43-8e96e04c5662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:24.120840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98a3545f-9442-42af-ad43-8e96e04c5662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:24.121280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98a3545f-9442-42af-ad43-8e96e04c5662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:24.122039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98a3545f-9442-42af-ad43-8e96e04c5662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:24.122488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98a3545f-9442-42af-ad43-8e96e04c5662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:24.135777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:24.143259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2551f938-4a3f-4682-a856-90f83c1f7c38 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151943 Jul 20 14:02:24.143876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 866/1538] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:24.153950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-98a3545f-9442-42af-ad43-8e96e04c5662 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Jul 20 14:02:24.154498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 673/1539] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:24 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:25.125821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:25.126430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:25.132941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:25.133390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:25.134152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:25.134594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:25.165058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a8ef9d3b-526a-476f-b4ba-21ca76ee22f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:25.166115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a8ef9d3b-526a-476f-b4ba-21ca76ee22f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:25.172539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9d3b-526a-476f-b4ba-21ca76ee22f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:25.172982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9d3b-526a-476f-b4ba-21ca76ee22f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:25.173740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9d3b-526a-476f-b4ba-21ca76ee22f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:25.174166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9d3b-526a-476f-b4ba-21ca76ee22f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:25.204123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a8ef9d3b-526a-476f-b4ba-21ca76ee22f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Jul 20 14:02:25.204718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 674/1540] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:02:25.210490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:25.211095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:25.217063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:25.217468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:25.218239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:25.218673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:25.267216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:25.275109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-df20a7c3-f62f-4719-8267-f5bd74dccf11 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153194 Jul 20 14:02:25.275683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 867/1541] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:25 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:25.349691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:25.357070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-58ab493d-53d0-4b12-b3f4-485c7487a565 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151419 Jul 20 14:02:25.357637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 675/1542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:26.215839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88697e8e-5e5f-41d0-b839-3841693a971c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:26.216791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-88697e8e-5e5f-41d0-b839-3841693a971c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:26.223298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88697e8e-5e5f-41d0-b839-3841693a971c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:26.223749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88697e8e-5e5f-41d0-b839-3841693a971c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:26.224546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88697e8e-5e5f-41d0-b839-3841693a971c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:26.224986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88697e8e-5e5f-41d0-b839-3841693a971c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:26.253046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-88697e8e-5e5f-41d0-b839-3841693a971c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041237 Jul 20 14:02:26.253602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 868/1543] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:26.291624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:26.292265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:26.298575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:26.299008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:26.299754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:26.300183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:26.374845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:26.376016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:26.382426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:26.382875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:26.383646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:26.384082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:26.427071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:26.434801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-594c4aed-058c-42e1-b6b2-477164ecac43 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146928 Jul 20 14:02:26.435365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 676/1544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:26 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:26.514350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:26.521856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f4f0781c-6cfb-4f69-a3d2-5cb74b599377 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150854 Jul 20 14:02:26.522422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 869/1545] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:27.265268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-52f1b006-e86c-4899-953e-40634e01a77f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:27.266107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-52f1b006-e86c-4899-953e-40634e01a77f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:27.272667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52f1b006-e86c-4899-953e-40634e01a77f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:27.273104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52f1b006-e86c-4899-953e-40634e01a77f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:27.273852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52f1b006-e86c-4899-953e-40634e01a77f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:27.274273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52f1b006-e86c-4899-953e-40634e01a77f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:27.302850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-52f1b006-e86c-4899-953e-40634e01a77f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041609 Jul 20 14:02:27.303435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 677/1546] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:27.452377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:27.452981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:27.460761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:27.461206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:27.461970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:27.462401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:27.539455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:27.539455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:27.545289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:27.545728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:27.546476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:27.546902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:27.594504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:27.602473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-548a4cb6-92d1-49cc-8200-66e0ed49a539 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153954 Jul 20 14:02:27.603055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 870/1547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:27 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:27.678356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:27.685813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e87aac99-d415-4dc7-945a-6a7e5cf5f93e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150917 Jul 20 14:02:27.686378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 678/1548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:28.313928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9d570201-c20a-4462-a531-7949569d629e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:28.314850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9d570201-c20a-4462-a531-7949569d629e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:28.320895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d570201-c20a-4462-a531-7949569d629e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:28.321349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d570201-c20a-4462-a531-7949569d629e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:28.322140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d570201-c20a-4462-a531-7949569d629e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:28.322582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d570201-c20a-4462-a531-7949569d629e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:28.351301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9d570201-c20a-4462-a531-7949569d629e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041323 Jul 20 14:02:28.351849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 871/1549] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:28.619000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:28.619565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:28.625777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:28.626223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:28.626984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:28.627416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:28.702793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:28.703421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:28.710512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:28.711033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:28.711782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:28.712225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:28.758933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:28.767223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-97aa97ab-0805-4e81-b2d5-a84d715dfae4 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152023 Jul 20 14:02:28.767790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 679/1550] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:28 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:28.845524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:28.853183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-333b9667-1d9a-42a8-82ac-024d5ff8e8b8 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154208 Jul 20 14:02:28.853750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 872/1551] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:29.363207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dd3c9ca0-6722-4246-9fe3-95a22f4c701e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:29.364659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dd3c9ca0-6722-4246-9fe3-95a22f4c701e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:29.370763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd3c9ca0-6722-4246-9fe3-95a22f4c701e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:29.371209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd3c9ca0-6722-4246-9fe3-95a22f4c701e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:29.371966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd3c9ca0-6722-4246-9fe3-95a22f4c701e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:29.372428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dd3c9ca0-6722-4246-9fe3-95a22f4c701e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:29.396771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:29.401524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dd3c9ca0-6722-4246-9fe3-95a22f4c701e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Jul 20 14:02:29.402074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 680/1552] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:29.784329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:29.784959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:29.791836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:29.792304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:29.793057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:29.793483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:29.871452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:29.872063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:29.878667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:29.879112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:29.879877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:29.880343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:29.923060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:29.931698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-70f5c23e-8bf6-4a07-b3da-255b9ccfdaec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151186 Jul 20 14:02:29.932288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 873/1553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:29 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:30.009462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:30.016961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e2cfd660-087d-4572-8e2a-339634bab010 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149612 Jul 20 14:02:30.017525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 681/1554] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:30.413247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-119a415a-2a82-40b3-9ef2-1df2fcaefb2d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:30.414173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-119a415a-2a82-40b3-9ef2-1df2fcaefb2d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:30.420095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-119a415a-2a82-40b3-9ef2-1df2fcaefb2d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:30.420569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-119a415a-2a82-40b3-9ef2-1df2fcaefb2d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:30.421333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-119a415a-2a82-40b3-9ef2-1df2fcaefb2d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:30.421762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-119a415a-2a82-40b3-9ef2-1df2fcaefb2d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:30.437816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:30.450957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-119a415a-2a82-40b3-9ef2-1df2fcaefb2d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Jul 20 14:02:30.451505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 874/1555] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:30.949054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:30.949703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:30.956123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:30.956902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:30.957673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:30.958109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:31.034749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:31.034749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:31.041251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:31.041692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:31.042445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:31.042867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:31.089414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:31.097216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0fc8a91c-e8ee-4558-a5e5-30f618c60672 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152113 Jul 20 14:02:31.098538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 682/1556] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:30 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:31.177083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:31.184951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8f4ec1cd-2d6f-41e4-80c2-82ff4954f0b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154599 Jul 20 14:02:31.185512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 875/1557] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:31.463554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-435c0649-d0cb-4db2-ab8b-847dea167dc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:31.464541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-435c0649-d0cb-4db2-ab8b-847dea167dc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:31.470479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-435c0649-d0cb-4db2-ab8b-847dea167dc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:31.470928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-435c0649-d0cb-4db2-ab8b-847dea167dc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:31.471690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-435c0649-d0cb-4db2-ab8b-847dea167dc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:31.472332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-435c0649-d0cb-4db2-ab8b-847dea167dc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:31.500783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-435c0649-d0cb-4db2-ab8b-847dea167dc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041253 Jul 20 14:02:31.501330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 683/1558] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:32.115133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:32.115767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:32.122190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:32.122634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:32.123382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:32.123809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:32.202113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:32.202764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:32.210059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:32.210533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:32.211279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:32.211746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:32.252953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:32.260774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-62f654fc-7108-4a27-b7b7-963f832f1f8f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150042 Jul 20 14:02:32.261341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 876/1559] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:32 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:32.340214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:32.347619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7efcca64-23dc-4e55-acf9-beecb2f2ae9a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149593 Jul 20 14:02:32.348289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 684/1560] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:32.513019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-19668be9-904f-4437-952e-ee1e52825b12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:32.513937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-19668be9-904f-4437-952e-ee1e52825b12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:32.519849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19668be9-904f-4437-952e-ee1e52825b12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:32.520334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19668be9-904f-4437-952e-ee1e52825b12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:32.521096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19668be9-904f-4437-952e-ee1e52825b12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:32.521562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19668be9-904f-4437-952e-ee1e52825b12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:32.549438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-19668be9-904f-4437-952e-ee1e52825b12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040397 Jul 20 14:02:32.550004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 877/1561] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:33.278200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:33.278886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:33.285301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:33.285741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:33.286497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:33.286920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:33.365135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:33.365748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:33.372248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:33.372700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:33.373464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:33.373896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:33.414205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:33.422110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cc5f2a78-a2d0-41a2-a466-d3b0f038ac46 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147789 Jul 20 14:02:33.422673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 685/1562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:33 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:33.505659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:33.513108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40d745c8-7ded-4e16-bc78-12d3e47b63bc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.152482 Jul 20 14:02:33.513682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 878/1563] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:33.561105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61e3f6ce-8c8b-4e5d-8d02-2642525456ad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:33.561947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61e3f6ce-8c8b-4e5d-8d02-2642525456ad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:33.567831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e3f6ce-8c8b-4e5d-8d02-2642525456ad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:33.568306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e3f6ce-8c8b-4e5d-8d02-2642525456ad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:33.569058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e3f6ce-8c8b-4e5d-8d02-2642525456ad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:33.569484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61e3f6ce-8c8b-4e5d-8d02-2642525456ad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:33.597475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61e3f6ce-8c8b-4e5d-8d02-2642525456ad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040315 Jul 20 14:02:33.598529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 686/1564] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:33.836982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:02:33.837167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:02:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:02:34.439798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:34.440469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:34.446887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:34.447328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:34.448082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:34.448540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:34.530154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:34.530762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:34.538138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:34.538582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:34.539352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:34.539810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:34.575171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:34.584102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1777206b-2da9-43b1-a78f-cc2616b73975 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148135 Jul 20 14:02:34.584710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 879/1565] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:34 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:34.609443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88209ead-9893-4d70-9176-c485a42df29c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:34.610364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-88209ead-9893-4d70-9176-c485a42df29c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:34.616336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88209ead-9893-4d70-9176-c485a42df29c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:34.616789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88209ead-9893-4d70-9176-c485a42df29c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:34.617560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88209ead-9893-4d70-9176-c485a42df29c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:34.617990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88209ead-9893-4d70-9176-c485a42df29c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:34.649764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-88209ead-9893-4d70-9176-c485a42df29c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Jul 20 14:02:34.650568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 880/1566] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:02:34.678380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:34.685746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-823c9aec-cf3e-4b74-8e5e-3b810a57270d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.159523 Jul 20 14:02:34.686307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 687/1567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:34.689431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:02:34.689643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:02:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:02:35.601711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:35.602333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:35.608653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:35.609094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:35.609840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:35.610271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:35.662277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-414ae46e-161b-4f0c-875f-acab876cf345 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:35.663230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-414ae46e-161b-4f0c-875f-acab876cf345 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:35.670278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-414ae46e-161b-4f0c-875f-acab876cf345 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:35.670727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-414ae46e-161b-4f0c-875f-acab876cf345 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:35.671520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-414ae46e-161b-4f0c-875f-acab876cf345 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:35.671956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-414ae46e-161b-4f0c-875f-acab876cf345 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:35.704932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-414ae46e-161b-4f0c-875f-acab876cf345 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047400 Jul 20 14:02:35.705515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 688/1568] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:35.710724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:35.711331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:35.717635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:35.718082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:35.718868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:35.719303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:35.863482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:35.871520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-490ab107-6e40-4c5c-b482-59fecd2a409d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.165054 Jul 20 14:02:35.872081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 689/1569] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:35.887270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:35.895044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ea7e21f0-51dd-456d-90d0-a6fec73547ae tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.297730 Jul 20 14:02:35.895594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 881/1570] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:35 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:36.716831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-66d1c8c0-731a-41a7-8437-1cd99122f786 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:36.717673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-66d1c8c0-731a-41a7-8437-1cd99122f786 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:36.724160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66d1c8c0-731a-41a7-8437-1cd99122f786 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:36.724640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66d1c8c0-731a-41a7-8437-1cd99122f786 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:36.725400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66d1c8c0-731a-41a7-8437-1cd99122f786 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:36.725834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-66d1c8c0-731a-41a7-8437-1cd99122f786 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:36.755688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-66d1c8c0-731a-41a7-8437-1cd99122f786 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 Jul 20 14:02:36.756291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 690/1571] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:36.887552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:36.888174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:36.894749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:36.895197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:36.895964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:36.896436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:36.911728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:36.912423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:36.918255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:36.918695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:36.919446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:36.919872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:37.028713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:37.036099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-02909747-2cbe-4f27-b93a-76227d0f119a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.152374 Jul 20 14:02:37.036688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 882/1572] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:37.051536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:37.059300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-90176026-c691-403a-beb0-3d16a92d1fd6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151357 Jul 20 14:02:37.059849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 691/1573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:36 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:37.767291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b52596c-4771-42fd-8de7-88b7de4dfa2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:37.768218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b52596c-4771-42fd-8de7-88b7de4dfa2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:37.770595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=78 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:37.775849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b52596c-4771-42fd-8de7-88b7de4dfa2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:37.776321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b52596c-4771-42fd-8de7-88b7de4dfa2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:37.777080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b52596c-4771-42fd-8de7-88b7de4dfa2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:37.777506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b52596c-4771-42fd-8de7-88b7de4dfa2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:37.805408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b52596c-4771-42fd-8de7-88b7de4dfa2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Jul 20 14:02:37.805935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 883/1574] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:38.052986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:38.053589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:38.059977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:38.060448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:38.061195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:38.061621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:38.076995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:38.077605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:38.085379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:38.085833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:38.086640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:38.087070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:38.195403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:38.202906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ead37068-5ac6-4f0b-935a-5be9c85bfa45 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153751 Jul 20 14:02:38.203737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 692/1575] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:38.228075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:38.235910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-81098727-5ef7-4242-b56f-c19e65889bb6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.162819 Jul 20 14:02:38.236492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 884/1576] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:38 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:38.817407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-804e063e-2db0-46a1-a5f0-86445ecf1bd9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:38.818244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-804e063e-2db0-46a1-a5f0-86445ecf1bd9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:38.820135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=82 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:38.825620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804e063e-2db0-46a1-a5f0-86445ecf1bd9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:38.826061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804e063e-2db0-46a1-a5f0-86445ecf1bd9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:38.826843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804e063e-2db0-46a1-a5f0-86445ecf1bd9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:38.827296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804e063e-2db0-46a1-a5f0-86445ecf1bd9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:38.855840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-804e063e-2db0-46a1-a5f0-86445ecf1bd9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Jul 20 14:02:38.856412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 693/1577] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:38 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:39.220568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:39.221176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:39.227664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:39.228110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:39.228909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:39.229341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:39.253324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:39.253870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:39.260884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:39.261331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:39.262086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:39.262512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:39.362708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:39.371035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-79fb658f-a661-4caf-aeeb-2021756b6b10 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154338 Jul 20 14:02:39.371616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 885/1578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:39.397016 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:39.405014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9db35035-3f00-4f0a-b81b-0479e081ecdd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.155523 Jul 20 14:02:39.405571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 694/1579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:39 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:39.867141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f0a2db2c-523e-4fce-86d3-996d1454b630 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:39.867971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f0a2db2c-523e-4fce-86d3-996d1454b630 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:39.873897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0a2db2c-523e-4fce-86d3-996d1454b630 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:39.874342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0a2db2c-523e-4fce-86d3-996d1454b630 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:39.875091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0a2db2c-523e-4fce-86d3-996d1454b630 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:39.875521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f0a2db2c-523e-4fce-86d3-996d1454b630 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:39.903071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f0a2db2c-523e-4fce-86d3-996d1454b630 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040037 Jul 20 14:02:39.903607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 886/1580] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:40.387640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:40.388283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:40.394806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:40.395249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:40.396011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:40.396489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:40.423051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:40.423690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:40.430820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:40.431272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:40.432046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:40.432514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:40.527720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:40.535311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-82d5edd4-3a19-458b-afa8-7c42214ae45e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151549 Jul 20 14:02:40.536450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 695/1581] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:40.564300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:40.572322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-05a81aa9-7ca8-4f81-87f4-b7618257a86c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153288 Jul 20 14:02:40.572935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 887/1582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:40 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:40.914548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2dbfc52b-dd94-4815-92ce-acf257aa655c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:40.915473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2dbfc52b-dd94-4815-92ce-acf257aa655c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:40.921511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2dbfc52b-dd94-4815-92ce-acf257aa655c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:40.921961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2dbfc52b-dd94-4815-92ce-acf257aa655c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:40.922726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2dbfc52b-dd94-4815-92ce-acf257aa655c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:40.923165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2dbfc52b-dd94-4815-92ce-acf257aa655c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:40.951469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2dbfc52b-dd94-4815-92ce-acf257aa655c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040938 Jul 20 14:02:40.952007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 696/1583] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:41.553258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:41.553869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:41.560325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:41.560776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:41.561542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:41.561981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:41.589364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:41.589953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:41.597001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:41.597452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:41.598935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:41.599414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:41.619078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:41.697116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:41.704498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-53b72905-0eb4-4c9d-8b9b-d657fffed866 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155602 Jul 20 14:02:41.705062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 888/1584] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:41.734359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:41.742824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-02ec5a38-35f3-45dc-900b-a7fdce457615 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.157288 Jul 20 14:02:41.743380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 697/1585] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:41 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:41.963525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-10b2536c-b6e4-4280-aa91-ddc34fb54c9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:41.964550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-10b2536c-b6e4-4280-aa91-ddc34fb54c9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:41.970893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10b2536c-b6e4-4280-aa91-ddc34fb54c9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:41.971342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10b2536c-b6e4-4280-aa91-ddc34fb54c9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:41.972228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10b2536c-b6e4-4280-aa91-ddc34fb54c9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:41.972655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10b2536c-b6e4-4280-aa91-ddc34fb54c9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:42.001665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-10b2536c-b6e4-4280-aa91-ddc34fb54c9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Jul 20 14:02:42.002206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 889/1586] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:42.721905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:42.722424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:42.728838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:42.729276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:42.730055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:42.730478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:42.759377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:42.760080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:42.766577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:42.767101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:42.767935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:42.768552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:42.863372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:42.871307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3d5d0860-9539-481d-80c9-0bc670261595 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153412 Jul 20 14:02:42.871873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 698/1587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:42.895717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:42.903616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-79172cef-e1dc-478c-81ec-33dc41c6ce9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148633 Jul 20 14:02:42.904204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 890/1588] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:42 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:43.013153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-362568a8-0cac-4af6-a55d-f38c5cbd9b7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:43.013984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-362568a8-0cac-4af6-a55d-f38c5cbd9b7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:43.019983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-362568a8-0cac-4af6-a55d-f38c5cbd9b7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:43.020457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-362568a8-0cac-4af6-a55d-f38c5cbd9b7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:43.021212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-362568a8-0cac-4af6-a55d-f38c5cbd9b7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:43.021648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-362568a8-0cac-4af6-a55d-f38c5cbd9b7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:43.050248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-362568a8-0cac-4af6-a55d-f38c5cbd9b7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Jul 20 14:02:43.050788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 699/1589] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:43.889112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:43.889644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:43.896841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:43.897289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:43.898055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:43.898493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:43.902424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:43.920112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:43.920873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:43.927256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:43.927700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:43.928505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:43.928935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:44.035088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:44.043004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-086e50eb-ea62-4b13-9cd0-03452912e3d6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.157851 Jul 20 14:02:44.043578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 891/1590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:44.058705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:44.061935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0c4c3c0f-75d7-411f-adbc-566ff0870673 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:44.062859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0c4c3c0f-75d7-411f-adbc-566ff0870673 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:44.067205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b8cb4e0f-11a8-46ff-a75f-250ce37e90ea tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150408 Jul 20 14:02:44.067843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 700/1591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:43 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:44.069262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4c3c0f-75d7-411f-adbc-566ff0870673 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:44.069718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4c3c0f-75d7-411f-adbc-566ff0870673 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:44.070487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4c3c0f-75d7-411f-adbc-566ff0870673 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:44.070919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4c3c0f-75d7-411f-adbc-566ff0870673 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:44.100129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0c4c3c0f-75d7-411f-adbc-566ff0870673 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042059 Jul 20 14:02:44.100701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 892/1592] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:02:45.060477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:45.061081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:45.068159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:45.068620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:45.069373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:45.069798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:45.084496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:45.085114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:45.092562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:45.093014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:45.093784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:45.094220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:45.204177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:45.213380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46b4de86-6743-4419-8da3-94ee7cf9a65b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.157000 Jul 20 14:02:45.214044 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 701/1593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:45.218614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c6698f5-0248-4af0-ae03-2a8d56b95479 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:45.219523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c6698f5-0248-4af0-ae03-2a8d56b95479 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:45.225507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c6698f5-0248-4af0-ae03-2a8d56b95479 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:45.225956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c6698f5-0248-4af0-ae03-2a8d56b95479 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:45.226725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c6698f5-0248-4af0-ae03-2a8d56b95479 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:45.227155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c6698f5-0248-4af0-ae03-2a8d56b95479 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:45.228566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:45.236469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-44d3863d-62db-4f9a-90f1-9b3f9e997990 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.156095 Jul 20 14:02:45.237044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 893/1594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:45 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:45.256968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c6698f5-0248-4af0-ae03-2a8d56b95479 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041922 Jul 20 14:02:45.257513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 702/1595] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:46.230450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:46.231093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:46.237569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:46.238009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:46.238786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:46.239224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:46.254586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:46.255209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:46.261671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:46.262123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:46.263017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:46.263461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:46.370172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:46.377672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-48c7b58b-5e4c-440f-8b0a-ff4f1f26a168 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151168 Jul 20 14:02:46.378237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 894/1596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:46.383358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-92a3b463-70e2-4581-bafe-e898d444a08b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:46.384297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-92a3b463-70e2-4581-bafe-e898d444a08b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:46.390125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92a3b463-70e2-4581-bafe-e898d444a08b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:46.390571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92a3b463-70e2-4581-bafe-e898d444a08b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:46.391340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92a3b463-70e2-4581-bafe-e898d444a08b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:46.391771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92a3b463-70e2-4581-bafe-e898d444a08b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:46.393745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:46.402275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-289fc3b5-2f71-422d-968b-d5e8ebdf0cf6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152093 Jul 20 14:02:46.404523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 703/1597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:46 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:46.422485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-92a3b463-70e2-4581-bafe-e898d444a08b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Jul 20 14:02:46.423030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 895/1598] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:47.395726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:47.396362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:47.402872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:47.403323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:47.404094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:47.404534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:47.418853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:47.419470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:47.425500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:47.425953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:47.426721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:47.427157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:47.533091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:47.541250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1ecdf18a-75cd-4088-a11d-96974aede1b5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149890 Jul 20 14:02:47.541810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 704/1599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:47.546336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-84ab7e31-9e13-4431-a913-9227d2447540 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:47.547254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-84ab7e31-9e13-4431-a913-9227d2447540 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:47.553185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84ab7e31-9e13-4431-a913-9227d2447540 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:47.553630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84ab7e31-9e13-4431-a913-9227d2447540 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:47.554398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84ab7e31-9e13-4431-a913-9227d2447540 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:47.554832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84ab7e31-9e13-4431-a913-9227d2447540 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:47.559001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:47.567724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-05709f1f-7fcd-4e43-8edb-f2787b29071e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152773 Jul 20 14:02:47.569276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 896/1600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:47 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:47.586862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-84ab7e31-9e13-4431-a913-9227d2447540 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 Jul 20 14:02:47.587412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 705/1601] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:48.558870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:48.559479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:48.565837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:48.566283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:48.567525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:48.567949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:48.586291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:48.586888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:48.594864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:48.595317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:48.596091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:48.596547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:48.703460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:48.711628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f834fd73-279d-4e73-ab9c-cb1f0eb6bf55 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.156634 Jul 20 14:02:48.712203 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 897/1602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:48.716719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5d43d8d8-6cbb-4c40-9098-3aa5c2014074 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:48.717614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5d43d8d8-6cbb-4c40-9098-3aa5c2014074 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:48.723265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d43d8d8-6cbb-4c40-9098-3aa5c2014074 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:48.723705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d43d8d8-6cbb-4c40-9098-3aa5c2014074 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:48.724510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d43d8d8-6cbb-4c40-9098-3aa5c2014074 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:48.724940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d43d8d8-6cbb-4c40-9098-3aa5c2014074 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:48.731840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:48.740082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-849585b0-04be-41c9-85c4-026f31503121 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.158660 Jul 20 14:02:48.740671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 706/1603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:48 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:48.755037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5d43d8d8-6cbb-4c40-9098-3aa5c2014074 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Jul 20 14:02:48.755585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 898/1604] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:49.728652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:49.729258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:49.735768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:49.736238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:49.737003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:49.737441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:49.757898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:49.758508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:49.764801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:49.765253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:49.766026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:49.766462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:49.867775 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:49.875363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-10426070-1fd1-4e77-8c16-3909b7509732 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.150616 Jul 20 14:02:49.875923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 707/1605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:49.880503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1e41a591-1ac7-4165-863c-77ab09cb389d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:49.881399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1e41a591-1ac7-4165-863c-77ab09cb389d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:49.887258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e41a591-1ac7-4165-863c-77ab09cb389d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:49.887636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e41a591-1ac7-4165-863c-77ab09cb389d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:49.888421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e41a591-1ac7-4165-863c-77ab09cb389d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:49.888846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e41a591-1ac7-4165-863c-77ab09cb389d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:49.899767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:49.907635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4e6e17e8-19d6-4c04-b655-a20667037565 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154236 Jul 20 14:02:49.908221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 899/1606] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:49 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:49.919074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1e41a591-1ac7-4165-863c-77ab09cb389d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Jul 20 14:02:49.919614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 708/1607] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:50.894854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:50.895916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:50.903747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:50.904217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:50.904989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:50.905422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:50.924266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:50.924872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:50.932577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:50.933027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:50.933788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:50.934214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:51.047443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:51.055010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-498a90a3-8171-4749-a674-6f0219bc35a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.167312 Jul 20 14:02:51.055582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 900/1608] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:51.060330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cbe7a5a0-f3a6-44f6-93eb-a0856d3e0f2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:51.061299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cbe7a5a0-f3a6-44f6-93eb-a0856d3e0f2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:51.067277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:51.069826 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe7a5a0-f3a6-44f6-93eb-a0856d3e0f2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:51.070276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe7a5a0-f3a6-44f6-93eb-a0856d3e0f2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:51.071053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe7a5a0-f3a6-44f6-93eb-a0856d3e0f2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:51.071486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe7a5a0-f3a6-44f6-93eb-a0856d3e0f2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:51.075526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-97e67126-ca39-40ff-9810-823045c78266 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.155042 Jul 20 14:02:51.076295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 709/1609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:50 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:51.101409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cbe7a5a0-f3a6-44f6-93eb-a0856d3e0f2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Jul 20 14:02:51.101963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 901/1610] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:52.072706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:52.073314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:52.079750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:52.080215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:52.080994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:52.081434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:52.093637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:52.094234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:52.101155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:52.101596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:52.102404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:52.102835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:52.213260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:52.220695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-de8d9306-a96b-47ae-b180-642693ecfdbe tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151896 Jul 20 14:02:52.221259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 710/1611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:52.226251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e02f79b2-7222-4963-9bcc-cb10f6cc3773 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:52.227158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e02f79b2-7222-4963-9bcc-cb10f6cc3773 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:52.233070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:52.233340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e02f79b2-7222-4963-9bcc-cb10f6cc3773 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:52.233792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e02f79b2-7222-4963-9bcc-cb10f6cc3773 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:52.234557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e02f79b2-7222-4963-9bcc-cb10f6cc3773 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:52.234991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e02f79b2-7222-4963-9bcc-cb10f6cc3773 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:52.242011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d6d3aa9b-d275-477c-a3b4-55adc0ae7b06 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152282 Jul 20 14:02:52.242580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 902/1612] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:52 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:52.263850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e02f79b2-7222-4963-9bcc-cb10f6cc3773 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Jul 20 14:02:52.264425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 711/1613] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:53.238150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:53.238745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:53.245165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:53.245609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:53.246365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:53.246797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:53.258724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:53.259419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:53.265920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:53.266435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:53.267204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:53.267643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:53.380163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:53.387753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-432f6b08-97b7-4d4a-8ef0-dbd22307d249 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153467 Jul 20 14:02:53.388359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 903/1614] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:53.393253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e89b73d3-c488-411a-b92c-732d954dcaf2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:53.394193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e89b73d3-c488-411a-b92c-732d954dcaf2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:53.400591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e89b73d3-c488-411a-b92c-732d954dcaf2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:53.401042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e89b73d3-c488-411a-b92c-732d954dcaf2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:53.401180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:53.401812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e89b73d3-c488-411a-b92c-732d954dcaf2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:53.402250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e89b73d3-c488-411a-b92c-732d954dcaf2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:53.409021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2988607d-32d5-4376-9565-b2db66545768 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154168 Jul 20 14:02:53.409575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 712/1615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:53 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:53.431385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e89b73d3-c488-411a-b92c-732d954dcaf2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Jul 20 14:02:53.431934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 904/1616] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:54.405529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:54.405928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:54.412861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:54.413307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:54.414072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:54.414502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:54.425372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:54.426713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:54.432960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:54.433408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:54.434175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:54.434606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:54.546337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:54.554649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-74dc1b29-a32a-48e0-8f32-17f26ae4f37e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153278 Jul 20 14:02:54.555208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 713/1617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:54.559814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0f02d6b6-f3f6-4c1c-854d-60ac5a54f0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:54.560750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0f02d6b6-f3f6-4c1c-854d-60ac5a54f0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:54.566443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f02d6b6-f3f6-4c1c-854d-60ac5a54f0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:54.566805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:54.567353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f02d6b6-f3f6-4c1c-854d-60ac5a54f0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:54.568428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f02d6b6-f3f6-4c1c-854d-60ac5a54f0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:54.568862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0f02d6b6-f3f6-4c1c-854d-60ac5a54f0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:54.572561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:54.575142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0448f666-d38c-4330-8fad-3d18391ab7ac tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.153629 Jul 20 14:02:54.575718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 905/1618] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:54 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:54.598250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0f02d6b6-f3f6-4c1c-854d-60ac5a54f0ba tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041552 Jul 20 14:02:54.598790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 714/1619] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:55.571589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:55.572259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:55.578839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:55.579289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:55.580058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:55.580545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:55.592674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:55.593414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:55.600688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:55.601138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:55.601905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:55.602338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:55.716805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:55.725032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bf4662c3-4ae9-42bb-9538-07ba7139637c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.157355 Jul 20 14:02:55.725638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 906/1620] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:55.730443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-938ff901-d43e-42f2-8db5-d8fc66619192 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:55.731414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-938ff901-d43e-42f2-8db5-d8fc66619192 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:55.737188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:55.738018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-938ff901-d43e-42f2-8db5-d8fc66619192 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:55.738466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-938ff901-d43e-42f2-8db5-d8fc66619192 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:55.739273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-938ff901-d43e-42f2-8db5-d8fc66619192 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:55.739708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-938ff901-d43e-42f2-8db5-d8fc66619192 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:55.745622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-64b0bf2f-7e83-4e59-a300-8ecfaa53608c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.156608 Jul 20 14:02:55.746256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 715/1621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:55 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:55.763919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:55.768927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-938ff901-d43e-42f2-8db5-d8fc66619192 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042310 Jul 20 14:02:55.769471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 907/1622] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:56.742176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:56.742822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:56.749290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:56.749735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:56.750502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:56.750937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:56.762545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:56.763158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:56.769717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:56.770171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:56.770933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:56.771950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:56.884728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:56.892171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ae7afd53-754c-4c83-9268-d5716f21e820 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153874 Jul 20 14:02:56.892845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 716/1623] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:56.897940 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4ef00cd2-00f2-4ddd-bc6a-8c429791a1fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:56.898857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4ef00cd2-00f2-4ddd-bc6a-8c429791a1fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:56.900787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:56.904672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ef00cd2-00f2-4ddd-bc6a-8c429791a1fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:56.905123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ef00cd2-00f2-4ddd-bc6a-8c429791a1fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:56.905899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ef00cd2-00f2-4ddd-bc6a-8c429791a1fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:56.906337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4ef00cd2-00f2-4ddd-bc6a-8c429791a1fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:56.909088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b59e3e0-6097-4918-a72a-db5e13dbf5d6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150411 Jul 20 14:02:56.909774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 908/1624] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:56 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:56.935038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4ef00cd2-00f2-4ddd-bc6a-8c429791a1fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Jul 20 14:02:56.935514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 717/1625] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:57.909688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:57.910304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:57.916861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:57.917306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:57.918064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:57.918497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:57.925885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:57.926552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:57.933486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:57.933941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:57.934707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:57.935145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:58.051305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:58.059441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-206a4885-6b99-4cf5-9030-ab150f19df72 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153692 Jul 20 14:02:58.060005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 909/1626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:58.064592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4cfa2796-b0cb-47c4-ada0-0ad60c7b5e83 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:58.065495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4cfa2796-b0cb-47c4-ada0-0ad60c7b5e83 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:58.065683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:58.071529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cfa2796-b0cb-47c4-ada0-0ad60c7b5e83 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:58.071969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cfa2796-b0cb-47c4-ada0-0ad60c7b5e83 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:58.072758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cfa2796-b0cb-47c4-ada0-0ad60c7b5e83 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:58.073193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cfa2796-b0cb-47c4-ada0-0ad60c7b5e83 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:58.074063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c21b28a-94b3-4882-a3de-0690e66adf9b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151905 Jul 20 14:02:58.074627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 718/1627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:57 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:02:58.101687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4cfa2796-b0cb-47c4-ada0-0ad60c7b5e83 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Jul 20 14:02:58.102224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 910/1628] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:02:59.076726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:59.077340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:59.084796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:59.085242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:59.086035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:59.086472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:59.091006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:59.091643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:59.098201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:59.098649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:59.099450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:59.100042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:59.221443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:59.229528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9f07ab79-5d9f-4f35-af7c-462a088dd722 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.156677 Jul 20 14:02:59.238871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 719/1629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:59.239221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:02:59.239346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cf35eaac-d727-4977-b354-111d6f48112f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:02:59.239346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cf35eaac-d727-4977-b354-111d6f48112f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:02:59.241662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-21c30429-50c9-420b-852a-1fe12ddb3a67 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154408 Jul 20 14:02:59.241884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf35eaac-d727-4977-b354-111d6f48112f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:59.242229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 911/1630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:02:59 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:02:59.242349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf35eaac-d727-4977-b354-111d6f48112f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:59.243145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf35eaac-d727-4977-b354-111d6f48112f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:02:59.243635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf35eaac-d727-4977-b354-111d6f48112f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:02:59.272521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cf35eaac-d727-4977-b354-111d6f48112f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Jul 20 14:02:59.273058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 720/1631] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:02:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:00.246971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:00.247580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:00.254196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:00.254648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:00.255421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:00.256466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:00.259201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:00.259813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:00.266098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:00.266542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:00.267350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:00.267787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:00.386982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:00.394771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-acc4a5ec-e424-40de-bdf7-cd808ff9ce47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151662 Jul 20 14:03:00.395339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 912/1632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:00.399424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:00.401375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c518826c-c8e9-4819-ad74-16f48b2a1b28 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:00.402220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c518826c-c8e9-4819-ad74-16f48b2a1b28 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:00.407349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8d088995-fdb0-46ef-9dc4-3481392af4a6 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.152757 Jul 20 14:03:00.408075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c518826c-c8e9-4819-ad74-16f48b2a1b28 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:00.408964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c518826c-c8e9-4819-ad74-16f48b2a1b28 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:00.409526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c518826c-c8e9-4819-ad74-16f48b2a1b28 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:00.409845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c518826c-c8e9-4819-ad74-16f48b2a1b28 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:00.417432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 721/1633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:00 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:00.440659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c518826c-c8e9-4819-ad74-16f48b2a1b28 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Jul 20 14:03:00.441273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 913/1634] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:01.410774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:01.411489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:01.418000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:01.418450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:01.419361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:01.419640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:01.424845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:01.425465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:01.432767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:01.433224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:01.433998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:01.434441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:01.553426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:01.560935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8ca00da7-68dc-42ef-9e20-2e9f46c4c24e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153970 Jul 20 14:03:01.561498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 722/1635] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:01.566218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-16e0f2e1-8580-4d28-a528-54e081d5d1fc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:01.569592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-16e0f2e1-8580-4d28-a528-54e081d5d1fc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:01.571272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:01.575972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16e0f2e1-8580-4d28-a528-54e081d5d1fc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:01.576532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16e0f2e1-8580-4d28-a528-54e081d5d1fc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:01.577464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16e0f2e1-8580-4d28-a528-54e081d5d1fc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:01.577985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-16e0f2e1-8580-4d28-a528-54e081d5d1fc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:01.579059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c07a289a-6a09-4e32-ac12-3429ee816db2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.158016 Jul 20 14:03:01.580406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 914/1636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:01 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:01.607776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-16e0f2e1-8580-4d28-a528-54e081d5d1fc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Jul 20 14:03:01.608352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 723/1637] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:02.577606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:02.578208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:02.585425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:02.585871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:02.586632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:02.587315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:02.595848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:02.596474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:02.603255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:02.603697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:02.604472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:02.604904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:02.718413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:02.726861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8c9ac32d-7561-4a32-9dd9-10ac2a6e27fc tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.153114 Jul 20 14:03:02.728027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 915/1638] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:02.732579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9a81b629-4f74-4b4a-a313-2762d06b0fce tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:02.733496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9a81b629-4f74-4b4a-a313-2762d06b0fce tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:02.737582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:02.741932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a81b629-4f74-4b4a-a313-2762d06b0fce tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:02.742382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a81b629-4f74-4b4a-a313-2762d06b0fce tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:02.743156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a81b629-4f74-4b4a-a313-2762d06b0fce tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:02.743592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a81b629-4f74-4b4a-a313-2762d06b0fce tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:02.746058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c99b017-9b43-45f9-bb21-2c5c528ec88c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154063 Jul 20 14:03:02.746618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 724/1639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:02 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:02.771846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9a81b629-4f74-4b4a-a313-2762d06b0fce tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Jul 20 14:03:02.772431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 916/1640] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:03.743866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:03.744493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:03.750916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:03.751362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:03.752117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:03.752573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:03.762620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:03.763236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:03.769715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:03.770173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:03.770941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:03.771378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:03.882557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:03.890091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-83ce121a-4394-46f6-85a5-5fb03fe8ca02 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.149981 Jul 20 14:03:03.890608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 725/1641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:03.895144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d36217e7-f09f-4e3a-b298-6b93087b2c25 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:03.896055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d36217e7-f09f-4e3a-b298-6b93087b2c25 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:03.901293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:03.902483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d36217e7-f09f-4e3a-b298-6b93087b2c25 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:03.902934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d36217e7-f09f-4e3a-b298-6b93087b2c25 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:03.903705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d36217e7-f09f-4e3a-b298-6b93087b2c25 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:03.904136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d36217e7-f09f-4e3a-b298-6b93087b2c25 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:03.909114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-67e40a13-d0ea-4bcb-b5cb-9b0f18c3d366 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150347 Jul 20 14:03:03.909712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 917/1642] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:03 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:03.933231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d36217e7-f09f-4e3a-b298-6b93087b2c25 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041630 Jul 20 14:03:03.933772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 726/1643] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:04.906910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:04.907516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:04.914509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:04.914950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:04.915702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:04.916126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:04.926538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:04.927148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:04.934193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:04.934644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:04.935423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:04.935858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:05.049705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:05.058060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-287640b5-c856-40f9-990c-3e8dac156920 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.154949 Jul 20 14:03:05.058735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 918/1644] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:05.063731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b5de4c39-91e8-4b2b-b242-f9844755799a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:05.065000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b5de4c39-91e8-4b2b-b242-f9844755799a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:05.072942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5de4c39-91e8-4b2b-b242-f9844755799a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:05.074393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5de4c39-91e8-4b2b-b242-f9844755799a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:05.074794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:05.075207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5de4c39-91e8-4b2b-b242-f9844755799a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:05.075751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5de4c39-91e8-4b2b-b242-f9844755799a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:05.083832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d9aa95ba-9ca9-40d9-b34c-41088481e94e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.160997 Jul 20 14:03:05.092327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 727/1645] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:04 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:05.109292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b5de4c39-91e8-4b2b-b242-f9844755799a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049236 Jul 20 14:03:05.109893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 919/1646] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:06.082573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:06.083316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:06.089841 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:06.090287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:06.091053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:06.091488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:06.100206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:06.100817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:06.107125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:06.107563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:06.108347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:06.108772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:06.223224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:06.230892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e46e68e3-7a30-4e82-9aee-f8a653ee92c9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.152405 Jul 20 14:03:06.231473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 728/1647] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:06.236022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e284dc71-03ed-48d2-8980-9ceb5c5ee51c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:06.236959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e284dc71-03ed-48d2-8980-9ceb5c5ee51c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:06.237523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:06.243452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e284dc71-03ed-48d2-8980-9ceb5c5ee51c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:06.243898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e284dc71-03ed-48d2-8980-9ceb5c5ee51c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:06.244691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e284dc71-03ed-48d2-8980-9ceb5c5ee51c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:06.245119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e284dc71-03ed-48d2-8980-9ceb5c5ee51c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:06.246676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-655f5979-84f5-408e-89e1-b6f7582fdd61 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150476 Jul 20 14:03:06.247497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 920/1648] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:06 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:06.273948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e284dc71-03ed-48d2-8980-9ceb5c5ee51c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041483 Jul 20 14:03:06.274487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 729/1649] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:07.249008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:07.249645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:07.256110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:07.256595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:07.257362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:07.257804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:07.262642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:07.263253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:07.269712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:07.270162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:07.270933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:07.271365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:07.393732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:07.400481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:07.402099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e4b070c6-01d5-4101-a373-2232f0c1c1c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.157016 Jul 20 14:03:07.402670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 921/1650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:07.403935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:07.407454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a1bd5fb4-c1aa-4722-9779-899baccd25eb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:07.408484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a1bd5fb4-c1aa-4722-9779-899baccd25eb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:07.409415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-19509157-8e4e-4603-b12e-62deb7c1210d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150570 Jul 20 14:03:07.410128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 730/1651] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:07 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:07.415210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1bd5fb4-c1aa-4722-9779-899baccd25eb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:07.415655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1bd5fb4-c1aa-4722-9779-899baccd25eb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:07.416443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1bd5fb4-c1aa-4722-9779-899baccd25eb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:07.416873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a1bd5fb4-c1aa-4722-9779-899baccd25eb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:07.444537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a1bd5fb4-c1aa-4722-9779-899baccd25eb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040861 Jul 20 14:03:07.445078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 922/1652] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:08.419322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:08.419926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:08.426558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:08.427036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:08.427156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:08.427257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:08.427895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:08.428351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:08.429670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=80 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:08.435003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:08.435457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:08.436242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:08.436685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:08.558238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:08.564386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:08.566645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b5c498a8-48e1-4c56-8424-1811658a3d0f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151076 Jul 20 14:03:08.567220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 731/1653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:08.572513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-33a01aef-7380-49a4-a127-f66d10f67c90 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:08.573508 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-33a01aef-7380-49a4-a127-f66d10f67c90 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:08.577456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-93e31b2a-ca8a-4889-aee5-1044577ff42b tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154671 Jul 20 14:03:08.578059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 923/1654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:08 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:08.580037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33a01aef-7380-49a4-a127-f66d10f67c90 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:08.580506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33a01aef-7380-49a4-a127-f66d10f67c90 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:08.581269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33a01aef-7380-49a4-a127-f66d10f67c90 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:08.581695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33a01aef-7380-49a4-a127-f66d10f67c90 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:08.610776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-33a01aef-7380-49a4-a127-f66d10f67c90 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 Jul 20 14:03:08.611320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 732/1655] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:09.585497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:09.586133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:09.592929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:09.593378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:09.594177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:09.594688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:09.595184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:09.595336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:09.597683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=80 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:09.603606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:09.604057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:09.604863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:09.605303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:09.614936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:09.735556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:09.736900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:09.743165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3311a575-633b-4b17-921d-6b6624018e74 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.162787 Jul 20 14:03:09.743738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 924/1656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:09.745026 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aeea60a7-4d3c-4286-9b1f-b73fab1825ec tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154027 Jul 20 14:03:09.745696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 733/1657] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:09 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:09.748296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d5fbeb77-8b8e-4668-b2d4-699327229fe3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:09.749187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d5fbeb77-8b8e-4668-b2d4-699327229fe3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:09.754949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5fbeb77-8b8e-4668-b2d4-699327229fe3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:09.755389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5fbeb77-8b8e-4668-b2d4-699327229fe3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:09.756162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5fbeb77-8b8e-4668-b2d4-699327229fe3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:09.756617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5fbeb77-8b8e-4668-b2d4-699327229fe3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:09.785405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d5fbeb77-8b8e-4668-b2d4-699327229fe3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040660 Jul 20 14:03:09.785961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 925/1658] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:10.760135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:10.760715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:10.762236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:10.762849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:10.767249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:10.767685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:10.768547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:10.768976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:10.769167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:10.769616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:10.770375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:10.770933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:10.901947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:10.904106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:10.909950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0b063ceb-1e15-43b5-ab78-165e63d640a1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151563 Jul 20 14:03:10.910519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 926/1659] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:10 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:10.911544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-382f510c-2187-4373-b74d-aecb9771132f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.155855 Jul 20 14:03:10.912271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 734/1660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:10.915569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b1bb738f-d6a2-4a49-9224-0e0d9fd2bcb0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:10.915569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b1bb738f-d6a2-4a49-9224-0e0d9fd2bcb0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:10.924072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1bb738f-d6a2-4a49-9224-0e0d9fd2bcb0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:10.924562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1bb738f-d6a2-4a49-9224-0e0d9fd2bcb0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:10.925326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1bb738f-d6a2-4a49-9224-0e0d9fd2bcb0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:10.925762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1bb738f-d6a2-4a49-9224-0e0d9fd2bcb0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:10.954286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b1bb738f-d6a2-4a49-9224-0e0d9fd2bcb0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 Jul 20 14:03:10.954839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 927/1661] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:11.928664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:11.929275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:11.931242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:11.931842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:11.935898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:11.936387 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:11.937158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:11.937587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:11.938311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:11.938770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:11.939548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:11.940121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:12.067824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:12.069294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:12.075844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e3baaf0b-7a47-4302-9478-c6544d9f12f5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148416 Jul 20 14:03:12.076445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 928/1662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:11 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:12.076689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-26137ec8-fa75-4cbb-84bb-cbd183affd3c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151963 Jul 20 14:03:12.077423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 735/1663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:12.081097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c59df00f-ddf1-447c-9271-baacaba75abb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:12.082048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c59df00f-ddf1-447c-9271-baacaba75abb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:12.088458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c59df00f-ddf1-447c-9271-baacaba75abb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:12.088906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c59df00f-ddf1-447c-9271-baacaba75abb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:12.089675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c59df00f-ddf1-447c-9271-baacaba75abb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:12.090110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c59df00f-ddf1-447c-9271-baacaba75abb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:12.119241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c59df00f-ddf1-447c-9271-baacaba75abb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Jul 20 14:03:12.119784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 929/1664] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:13.094196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:13.094763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:13.095149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:13.095254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:13.101725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:13.101892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:13.102167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:13.102327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:13.102917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:13.103090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:13.103345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:13.103524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:13.240596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:13.244125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:13.249237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5e9c6934-40ff-43f4-adff-11bd3d9b5425 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.158840 Jul 20 14:03:13.249805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 736/1665] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:13 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:13.251715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c7ab6a5a-078f-484a-b590-b3d511dac93b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.161331 Jul 20 14:03:13.260252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 930/1666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:13.260437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-211b0041-a567-485a-8bb4-eacf5bb24841 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:13.260437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-211b0041-a567-485a-8bb4-eacf5bb24841 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:13.261213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-211b0041-a567-485a-8bb4-eacf5bb24841 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:13.261659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-211b0041-a567-485a-8bb4-eacf5bb24841 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:13.262427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-211b0041-a567-485a-8bb4-eacf5bb24841 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:13.262858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-211b0041-a567-485a-8bb4-eacf5bb24841 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:13.291127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-211b0041-a567-485a-8bb4-eacf5bb24841 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040361 Jul 20 14:03:13.291666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 737/1667] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:14.266393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:14.266929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:14.267434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:14.268048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:14.274193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:14.274640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:14.274997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:14.275410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:14.275527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:14.275844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:14.276218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:14.276675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:14.404092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:14.407483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:14.412309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9102e003-0634-4be2-98b3-eb9280aa41a7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149819 Jul 20 14:03:14.413507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 931/1668] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:14 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:14.415406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1f36d1c8-0f7c-41a7-9e39-ad7f912d697c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.151729 Jul 20 14:03:14.416117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 738/1669] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:14.418252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b53ecee-8375-4d02-b569-047ddfbede31 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:14.420721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b53ecee-8375-4d02-b569-047ddfbede31 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:14.425329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b53ecee-8375-4d02-b569-047ddfbede31 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:14.425782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b53ecee-8375-4d02-b569-047ddfbede31 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:14.426556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b53ecee-8375-4d02-b569-047ddfbede31 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:14.426995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b53ecee-8375-4d02-b569-047ddfbede31 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:14.455277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b53ecee-8375-4d02-b569-047ddfbede31 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040781 Jul 20 14:03:14.455832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 932/1670] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:15.431144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:15.431754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:15.432045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:15.432698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:15.438258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:15.438701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:15.439112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:15.439461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:15.439564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:15.439892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:15.440339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:15.440774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:15.567756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:15.572105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:15.576327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b5a914a4-79ff-47d4-a620-90a68720346a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149663 Jul 20 14:03:15.576889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 739/1671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:15 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:15.580018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-217ebe8b-2d6d-4c03-aca8-8868c8128ca4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.152326 Jul 20 14:03:15.580782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 933/1672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:15.581879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1ea57c3a-a603-47b2-a14c-62556be72f37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:15.583107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1ea57c3a-a603-47b2-a14c-62556be72f37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:15.589531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ea57c3a-a603-47b2-a14c-62556be72f37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:15.590065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ea57c3a-a603-47b2-a14c-62556be72f37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:15.590830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ea57c3a-a603-47b2-a14c-62556be72f37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:15.591258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1ea57c3a-a603-47b2-a14c-62556be72f37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:15.618954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1ea57c3a-a603-47b2-a14c-62556be72f37 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040886 Jul 20 14:03:15.619491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 740/1673] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:16.594158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:16.594763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:16.597320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:16.597926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:16.601840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:16.602289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:16.603057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:16.603492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:16.604706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:16.605147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:16.605900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:16.606328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:16.743292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:16.744962 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:16.751215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ee6e8565-a0a4-4e17-b83d-fe1a8dda103d tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.160993 Jul 20 14:03:16.751790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 934/1674] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:16 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:16.752291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-51c41128-4b10-425c-9494-379b86165b87 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.158780 Jul 20 14:03:16.753148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 741/1675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:16.756365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cb3e143e-a56f-4aa3-bee7-34f7bd88f39d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:16.757476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cb3e143e-a56f-4aa3-bee7-34f7bd88f39d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:16.763228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb3e143e-a56f-4aa3-bee7-34f7bd88f39d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:16.763675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb3e143e-a56f-4aa3-bee7-34f7bd88f39d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:16.764456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb3e143e-a56f-4aa3-bee7-34f7bd88f39d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:16.764889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb3e143e-a56f-4aa3-bee7-34f7bd88f39d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:16.793751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cb3e143e-a56f-4aa3-bee7-34f7bd88f39d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040970 Jul 20 14:03:16.794947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 935/1676] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:17.768155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:17.768936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:17.769758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:17.770664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:17.776374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:17.776824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:17.777281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:17.777597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:17.777707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:17.778030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:17.778477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:17.778905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:17.941221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:17.954042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e6db6631-1853-4303-af0d-421e426d1be0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1450 microversion: 2.1 time: 0.188240 Jul 20 14:03:17.955047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 936/1677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:17.961429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a5f48943-6f7b-4156-8129-5ffdf87ad5c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:17.962658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a5f48943-6f7b-4156-8129-5ffdf87ad5c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:17.970911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5f48943-6f7b-4156-8129-5ffdf87ad5c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:17.971770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5f48943-6f7b-4156-8129-5ffdf87ad5c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:17.973927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5f48943-6f7b-4156-8129-5ffdf87ad5c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:17.974484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5f48943-6f7b-4156-8129-5ffdf87ad5c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:17.984433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:17.995659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-39152690-255c-484b-a0ab-fb5f454a5455 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.231253 Jul 20 14:03:17.996362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 742/1678] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:17 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:18.018681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a5f48943-6f7b-4156-8129-5ffdf87ad5c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062318 Jul 20 14:03:18.019322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 937/1679] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:18.870806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-1fc9046b-97f7-4356-b547-851932c3e4c0 req-a06ed5eb-e459-454d-8225-648897fe8a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f9c037-a55c-46c4-aae3-4929db5f0193", "name": "network-vif-deleted", "tag": "f1fd1db3-83b1-4e8d-a486-5ac886455b89"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:03:18.880626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-1fc9046b-97f7-4356-b547-851932c3e4c0 req-a06ed5eb-e459-454d-8225-648897fe8a30 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:18.881093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-1fc9046b-97f7-4356-b547-851932c3e4c0 req-a06ed5eb-e459-454d-8225-648897fe8a30 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:18.895331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-1fc9046b-97f7-4356-b547-851932c3e4c0 req-a06ed5eb-e459-454d-8225-648897fe8a30 service nova] Creating event network-vif-deleted:f1fd1db3-83b1-4e8d-a486-5ac886455b89 for instance 36f9c037-a55c-46c4-aae3-4929db5f0193 on hv-cinder-81914 Jul 20 14:03:18.902413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-1fc9046b-97f7-4356-b547-851932c3e4c0 req-a06ed5eb-e459-454d-8225-648897fe8a30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035200 Jul 20 14:03:18.905320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 743/1680] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:18.971171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:18.971772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:18.978929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:18.979365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:18.980118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:18.980570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:19.013077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:19.013777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:19.020019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:19.020506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:19.021270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:19.022242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:19.046191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:19.053748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f5e5afdb-9b67-47c2-a1de-258b0a859935 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086435 Jul 20 14:03:19.054314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 938/1681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:19.058851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-df0b2a16-093a-4a82-bf9c-a3adce03c5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:19.059759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-df0b2a16-093a-4a82-bf9c-a3adce03c5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:19.065770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df0b2a16-093a-4a82-bf9c-a3adce03c5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:19.066163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df0b2a16-093a-4a82-bf9c-a3adce03c5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:19.066942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df0b2a16-093a-4a82-bf9c-a3adce03c5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:19.067380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df0b2a16-093a-4a82-bf9c-a3adce03c5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:19.099602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-df0b2a16-093a-4a82-bf9c-a3adce03c5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Jul 20 14:03:19.100899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 939/1682] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:19.158256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:19.166200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6e7a28ad-4a52-476e-bf8a-cfaf823c2234 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.157258 Jul 20 14:03:19.166764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 744/1683] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:19 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:20.071471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:20.072107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:20.078580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:20.079026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:20.079781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:20.080237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:20.110910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9224eed2-2437-47cf-aaeb-e638e9fed958 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:20.111926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9224eed2-2437-47cf-aaeb-e638e9fed958 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:20.119231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224eed2-2437-47cf-aaeb-e638e9fed958 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:20.119680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224eed2-2437-47cf-aaeb-e638e9fed958 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:20.120491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224eed2-2437-47cf-aaeb-e638e9fed958 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:20.120929 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9224eed2-2437-47cf-aaeb-e638e9fed958 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:20.141655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:20.149239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8be2cbbf-57b1-4d63-aba9-a48367b52c99 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082285 Jul 20 14:03:20.149806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 940/1684] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:20.165870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9224eed2-2437-47cf-aaeb-e638e9fed958 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058808 Jul 20 14:03:20.166536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 745/1685] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:20 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:03:20.183149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:20.183751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:20.189662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:20.190105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:20.190864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:20.191287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:20.195174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:20.316539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:20.324347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d5a18b95-59bd-4c48-937c-a525ddfb2376 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.144843 Jul 20 14:03:20.324845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 941/1686] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:20 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:21.166499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:21.167108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:21.173705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:21.174143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:21.174893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:21.175321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:21.176650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-03289c19-9e33-411a-95cf-6661baa144cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:21.177944 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-03289c19-9e33-411a-95cf-6661baa144cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:21.185890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03289c19-9e33-411a-95cf-6661baa144cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:21.186313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03289c19-9e33-411a-95cf-6661baa144cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:21.187087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03289c19-9e33-411a-95cf-6661baa144cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:21.187514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03289c19-9e33-411a-95cf-6661baa144cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:21.216708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-03289c19-9e33-411a-95cf-6661baa144cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Jul 20 14:03:21.217277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 942/1687] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:03:21.241322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:21.248694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8770c163-1cd7-47e4-8fdb-94ec945a04d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086590 Jul 20 14:03:21.249253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 746/1688] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:21.341293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:21.341902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:21.347852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:21.348332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:21.349098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:21.349530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:21.480046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:21.487811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1222f884-e169-4300-900c-a5cb7790c189 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150337 Jul 20 14:03:21.488483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 943/1689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:21 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:22.228991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e5e663a2-c6ba-4f72-8407-ba77652605f5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:22.229838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e5e663a2-c6ba-4f72-8407-ba77652605f5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:22.236289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e5e663a2-c6ba-4f72-8407-ba77652605f5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:22.236732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e5e663a2-c6ba-4f72-8407-ba77652605f5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:22.237494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e5e663a2-c6ba-4f72-8407-ba77652605f5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:22.237917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e5e663a2-c6ba-4f72-8407-ba77652605f5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:22.264866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:22.265557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:22.266592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e5e663a2-c6ba-4f72-8407-ba77652605f5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042323 Jul 20 14:03:22.267325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 747/1690] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:22.272809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:22.273263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:22.274036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:22.274506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:22.335646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:22.342986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28094ebe-9c24-467a-8398-8beee16f5e4f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081998 Jul 20 14:03:22.343547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 944/1691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:22.505435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:22.506646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:22.515525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:22.515981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:22.516804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:22.517254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:22.521574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:22.686868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:22.695175 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c6f195d0-2205-419d-abac-48e53acc3af5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.193837 Jul 20 14:03:22.695729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 748/1692] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:22 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:23.278551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-93fcd227-0647-4395-8044-bab35a5a9f9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:23.279468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-93fcd227-0647-4395-8044-bab35a5a9f9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:23.286194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93fcd227-0647-4395-8044-bab35a5a9f9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:23.286637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93fcd227-0647-4395-8044-bab35a5a9f9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:23.287429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93fcd227-0647-4395-8044-bab35a5a9f9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:23.287853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93fcd227-0647-4395-8044-bab35a5a9f9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:23.326256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-93fcd227-0647-4395-8044-bab35a5a9f9d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051613 Jul 20 14:03:23.326804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 945/1693] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:23.359496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:23.360099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:23.366497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:23.366938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:23.367690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:23.368117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:23.427412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:23.434762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b511b779-98f0-4c74-8a54-32f8406efa30 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079036 Jul 20 14:03:23.435320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 749/1694] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:23.712928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:23.713540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:23.719502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:23.719951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:23.720738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:23.721174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:23.847874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:23.856430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-82d75b5e-3e33-451d-ba65-91a1143929a2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147850 Jul 20 14:03:23.857000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 946/1695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:23 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:24.338374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8c454082-0eed-44fd-85c7-cce1e553953f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:24.339288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8c454082-0eed-44fd-85c7-cce1e553953f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:24.345214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c454082-0eed-44fd-85c7-cce1e553953f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:24.345657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c454082-0eed-44fd-85c7-cce1e553953f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:24.346414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c454082-0eed-44fd-85c7-cce1e553953f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:24.346843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c454082-0eed-44fd-85c7-cce1e553953f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:24.374970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8c454082-0eed-44fd-85c7-cce1e553953f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Jul 20 14:03:24.375563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 750/1696] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:24 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:24.451786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:24.452440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:24.459656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:24.460105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:24.460897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:24.461326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:24.524921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:24.532363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e914cf4c-32e6-4687-a143-6a4dadbd533e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084347 Jul 20 14:03:24.532924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 947/1697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:24 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:24.873188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:24.873795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:24.879737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:24.880185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:24.881495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:24.881938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:25.023465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:25.031326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e0507328-7cd6-4a07-b278-9a7217489a12 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.161959 Jul 20 14:03:25.031898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 751/1698] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:24 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:25.387178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5e33619d-ee87-4feb-b75c-5681dc590a21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:25.388013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5e33619d-ee87-4feb-b75c-5681dc590a21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:25.393936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e33619d-ee87-4feb-b75c-5681dc590a21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:25.394373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e33619d-ee87-4feb-b75c-5681dc590a21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:25.395125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e33619d-ee87-4feb-b75c-5681dc590a21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:25.395551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e33619d-ee87-4feb-b75c-5681dc590a21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:25.423364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5e33619d-ee87-4feb-b75c-5681dc590a21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040279 Jul 20 14:03:25.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 948/1699] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:25.550163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:25.550782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:25.557259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:25.557708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:25.558476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:25.558911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:25.620561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:25.627965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-52ffcf90-4f31-4409-a639-92458f79c2d5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081706 Jul 20 14:03:25.628562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 752/1700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:26.048321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:26.048931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:26.055505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:26.055953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:26.056749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:26.057184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:26.409603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:26.417313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2c23621e-168a-4be4-9314-b9520659adc9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.372910 Jul 20 14:03:26.417873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 949/1701] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:26 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:26.434566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-92189c9a-b7a1-402f-a668-0446fcfb2414 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:26.435473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-92189c9a-b7a1-402f-a668-0446fcfb2414 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:26.441378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-92189c9a-b7a1-402f-a668-0446fcfb2414 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:26.441819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-92189c9a-b7a1-402f-a668-0446fcfb2414 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:26.442567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-92189c9a-b7a1-402f-a668-0446fcfb2414 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:26.442992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-92189c9a-b7a1-402f-a668-0446fcfb2414 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:26.471959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-92189c9a-b7a1-402f-a668-0446fcfb2414 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041247 Jul 20 14:03:26.472507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 753/1702] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:26.645396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:26.646004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:26.651990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:26.652460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:26.653215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:26.653640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:26.714489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:26.721802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8159b6df-4adb-422f-a014-fb5713ce2eec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080321 Jul 20 14:03:26.722358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 950/1703] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:27.434743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:27.435358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:27.441818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:27.442268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:27.443035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:27.444130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:27.483063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db3ec84b-4550-4c4c-981e-1576452c448e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:27.483985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-db3ec84b-4550-4c4c-981e-1576452c448e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:27.490949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db3ec84b-4550-4c4c-981e-1576452c448e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:27.491398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db3ec84b-4550-4c4c-981e-1576452c448e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:27.492178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db3ec84b-4550-4c4c-981e-1576452c448e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:27.492663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db3ec84b-4550-4c4c-981e-1576452c448e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:27.521946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-db3ec84b-4550-4c4c-981e-1576452c448e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042612 Jul 20 14:03:27.522425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 951/1704] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:03:27.570933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:27.578793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-33091617-8952-4227-b799-073a969f717a tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147939 Jul 20 14:03:27.579355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 754/1705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:27 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:27.738835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:27.739370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:27.745398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:27.745847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:27.746613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:27.747049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:27.807504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:27.815039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e575bf38-c284-402f-87a7-991440b32bef tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080199 Jul 20 14:03:27.815610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 952/1706] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:28.534103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-495befed-46d9-4f35-8b24-3846680b173e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:28.535100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-495befed-46d9-4f35-8b24-3846680b173e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:28.542270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495befed-46d9-4f35-8b24-3846680b173e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:28.542718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495befed-46d9-4f35-8b24-3846680b173e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:28.543483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495befed-46d9-4f35-8b24-3846680b173e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:28.543920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-495befed-46d9-4f35-8b24-3846680b173e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:28.572482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-495befed-46d9-4f35-8b24-3846680b173e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Jul 20 14:03:28.573039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 755/1707] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:28.594996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:28.595607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:28.602696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:28.603113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:28.603870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:28.604371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:28.733290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:28.741149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7ad5cdc9-e009-4015-be38-73c5fa08055c tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149952 Jul 20 14:03:28.741714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 953/1708] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:28 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:28.832036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:28.832923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:28.839398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:28.839849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:28.840641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:28.841077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:28.904634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:28.912080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e41e27eb-415b-41f6-b2ca-56c218367ef9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083937 Jul 20 14:03:28.912707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 756/1709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:29.584013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d4f0c973-c7a4-46ad-9732-91afddcd7980 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:29.584952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d4f0c973-c7a4-46ad-9732-91afddcd7980 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:29.590990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4f0c973-c7a4-46ad-9732-91afddcd7980 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:29.591426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4f0c973-c7a4-46ad-9732-91afddcd7980 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:29.592175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4f0c973-c7a4-46ad-9732-91afddcd7980 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:29.592624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4f0c973-c7a4-46ad-9732-91afddcd7980 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:29.624356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d4f0c973-c7a4-46ad-9732-91afddcd7980 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Jul 20 14:03:29.625056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 954/1710] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:29.758101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:29.758715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:29.765124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:29.765593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:29.766346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:29.766784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:29.892309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:29.900865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b1929b25-297b-44c0-8639-debb3dab64a9 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.146739 Jul 20 14:03:29.901427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 757/1711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:29 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:29.929259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:29.929861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:29.935766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:29.936225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:29.936978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:29.937402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:29.997055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:30.004442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dc02415a-5026-4941-81d2-c8120b53f692 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079529 Jul 20 14:03:30.005011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 955/1712] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:30.635260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a8e28df5-7ef4-40d8-a813-070b81cecae6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:30.636723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a8e28df5-7ef4-40d8-a813-070b81cecae6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:30.642368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8e28df5-7ef4-40d8-a813-070b81cecae6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:30.642813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8e28df5-7ef4-40d8-a813-070b81cecae6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:30.643583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8e28df5-7ef4-40d8-a813-070b81cecae6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:30.644007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8e28df5-7ef4-40d8-a813-070b81cecae6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:30.672424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a8e28df5-7ef4-40d8-a813-070b81cecae6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 Jul 20 14:03:30.672973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 758/1713] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:30.918723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:30.919337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:30.925775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:30.926226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:30.926992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:30.927433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:31.022231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:31.022842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:31.029258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:31.029735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:31.030503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:31.030934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:31.055117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:31.063141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f591e3fd-1d20-477b-ba3e-92fd07b72d0f tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.148358 Jul 20 14:03:31.063725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 956/1714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:30 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:31.092117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:31.099491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7405219e-c8fe-4319-a982-ec5db67b4287 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081722 Jul 20 14:03:31.100050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 759/1715] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:31.684628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6fa54388-61b9-455d-ad1f-68949a3cd17a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:31.685544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6fa54388-61b9-455d-ad1f-68949a3cd17a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:31.691621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa54388-61b9-455d-ad1f-68949a3cd17a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:31.692066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa54388-61b9-455d-ad1f-68949a3cd17a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:31.692859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa54388-61b9-455d-ad1f-68949a3cd17a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:31.693290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fa54388-61b9-455d-ad1f-68949a3cd17a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:31.717606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:31.722589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6fa54388-61b9-455d-ad1f-68949a3cd17a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Jul 20 14:03:31.723135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 957/1716] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:32.080638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:32.081242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:32.088021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:32.088488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:32.089246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:32.089675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:32.116891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:32.117501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:32.124103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:32.124574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:32.125346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:32.125914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:32.187114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:32.194773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-47153492-1454-443d-b349-5d9bf8f019ab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082588 Jul 20 14:03:32.195341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 958/1717] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:32.223272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:32.231736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c5a36d5f-aead-457a-943e-7538f567e2c2 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.154947 Jul 20 14:03:32.232319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 760/1718] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:32 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:32.734222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-785c31f5-2d87-4b2b-8043-e04fdbe0d98b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:32.735077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-785c31f5-2d87-4b2b-8043-e04fdbe0d98b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:32.741209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-785c31f5-2d87-4b2b-8043-e04fdbe0d98b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:32.741659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-785c31f5-2d87-4b2b-8043-e04fdbe0d98b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:32.742424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-785c31f5-2d87-4b2b-8043-e04fdbe0d98b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:32.742861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-785c31f5-2d87-4b2b-8043-e04fdbe0d98b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:32.771031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-785c31f5-2d87-4b2b-8043-e04fdbe0d98b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040943 Jul 20 14:03:32.771609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 959/1719] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:33.215335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:33.216008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:33.223493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:33.223942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:33.224760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:33.225197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:33.249367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:33.250074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:33.257336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:33.257903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:33.258678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:33.259114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:33.285888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:33.293898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-53029c3c-a4ad-49b7-87c9-14ff66a99280 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086398 Jul 20 14:03:33.294466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 761/1720] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:33.387058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:33.394819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-570012eb-ae57-4d1c-b550-7db359da0f7e tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149335 Jul 20 14:03:33.395385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 960/1721] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:33 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:33.782615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fd94e8cb-ecc7-441b-a4dc-ee73d50683fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:33.783536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fd94e8cb-ecc7-441b-a4dc-ee73d50683fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:33.790107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd94e8cb-ecc7-441b-a4dc-ee73d50683fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:33.790551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd94e8cb-ecc7-441b-a4dc-ee73d50683fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:33.791304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd94e8cb-ecc7-441b-a4dc-ee73d50683fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:33.791735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd94e8cb-ecc7-441b-a4dc-ee73d50683fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:33.819639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fd94e8cb-ecc7-441b-a4dc-ee73d50683fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041000 Jul 20 14:03:33.820170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 762/1722] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:34.310435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:34.311041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:34.317502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:34.317946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:34.319193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:34.319624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:34.378845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:34.386592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-15b3a3bd-94ec-4ba9-a336-1c193dcfa4ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080070 Jul 20 14:03:34.387156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 961/1723] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:34.410755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:34.411368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:34.417816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:34.418269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:34.419031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:34.419468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:34.545603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:34.553923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a91c078d-9dff-45e4-a6ff-2f148dfe7374 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.147124 Jul 20 14:03:34.554487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 763/1724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:34 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:34.831136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-964824bd-3cd8-44f5-b928-365e074f3adc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:34.832089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-964824bd-3cd8-44f5-b928-365e074f3adc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:34.839003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-964824bd-3cd8-44f5-b928-365e074f3adc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:34.839453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-964824bd-3cd8-44f5-b928-365e074f3adc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:34.840235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-964824bd-3cd8-44f5-b928-365e074f3adc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:34.840667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-964824bd-3cd8-44f5-b928-365e074f3adc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:34.868771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-964824bd-3cd8-44f5-b928-365e074f3adc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Jul 20 14:03:34.869349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 962/1725] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:03:35.403397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:35.404006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:35.410057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:35.410502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:35.411256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:35.411762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:35.476363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:35.479691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:35.484912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e92e98cd-a3af-4915-9aa2-45bbb2683b47 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.085362 Jul 20 14:03:35.485471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 764/1726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:35.571158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:35.571783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:35.578219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:35.578662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:35.579414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:35.579841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:35.708728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:35.716913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c8a69ae6-0ed7-43d2-a5e6-8601ce2db1dd tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.150073 Jul 20 14:03:35.717478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 963/1727] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:35 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:35.880602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-08f04763-fb32-4dcf-993a-cd196f59f006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:35.881534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-08f04763-fb32-4dcf-993a-cd196f59f006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:35.887733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08f04763-fb32-4dcf-993a-cd196f59f006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:35.888171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08f04763-fb32-4dcf-993a-cd196f59f006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:35.888955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08f04763-fb32-4dcf-993a-cd196f59f006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:35.889649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08f04763-fb32-4dcf-993a-cd196f59f006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:35.918164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-08f04763-fb32-4dcf-993a-cd196f59f006 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Jul 20 14:03:35.918641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 765/1728] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:36.502005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:36.502617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:36.509152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:36.509598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:36.510360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:36.510793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:36.570259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:36.578130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f5c2e487-74ff-4c7d-9aa1-a7628b0fc01f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080016 Jul 20 14:03:36.578710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 964/1729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:36.733868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:36.734476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:36.741513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:36.741955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:36.742707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:36.743137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:36.867800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:36.875536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5884d8c1-4ab8-47b2-9ea8-377016eb08af tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.145561 Jul 20 14:03:36.876095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 766/1730] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:36 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:36.930146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-438dfb12-d09a-4f76-97ba-e73c0aaaa9b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:36.931109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-438dfb12-d09a-4f76-97ba-e73c0aaaa9b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:36.937174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438dfb12-d09a-4f76-97ba-e73c0aaaa9b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:36.937568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438dfb12-d09a-4f76-97ba-e73c0aaaa9b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:36.938335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438dfb12-d09a-4f76-97ba-e73c0aaaa9b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:36.938801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438dfb12-d09a-4f76-97ba-e73c0aaaa9b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:36.967688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-438dfb12-d09a-4f76-97ba-e73c0aaaa9b5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Jul 20 14:03:36.968249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 965/1731] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:37.595767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:37.596420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:37.603451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:37.603897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:37.604689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:37.605119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:37.665662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:37.673115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c9f132c9-7e11-4918-9c17-7ccbeb7bf105 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081261 Jul 20 14:03:37.673665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 767/1732] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:37.893044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:37.893667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:37.900812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:37.901265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:37.902031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:37.902470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:37.978891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff58d138-3da1-403e-90a6-53c7bb77d6e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:37.979817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff58d138-3da1-403e-90a6-53c7bb77d6e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:37.986311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff58d138-3da1-403e-90a6-53c7bb77d6e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:37.986888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff58d138-3da1-403e-90a6-53c7bb77d6e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:37.987658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff58d138-3da1-403e-90a6-53c7bb77d6e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:37.988093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff58d138-3da1-403e-90a6-53c7bb77d6e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:38.019094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff58d138-3da1-403e-90a6-53c7bb77d6e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Jul 20 14:03:38.019656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 768/1733] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:03:38.032560 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:38.040465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bae33d1f-0354-4826-97e6-3b4d0a791efe tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151314 Jul 20 14:03:38.041037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 966/1734] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:37 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:38.689834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:38.690367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:38.696324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:38.696778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:38.697531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:38.697960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:38.757742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:38.765176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5b1e4a30-b01c-4686-9bcb-753a37b8da6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079267 Jul 20 14:03:38.765737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 769/1735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:39.031822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1983af01-47c3-4ef3-9812-4263889e3381 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:39.032724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1983af01-47c3-4ef3-9812-4263889e3381 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:39.035099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=88 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:39.041389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1983af01-47c3-4ef3-9812-4263889e3381 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:39.041831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1983af01-47c3-4ef3-9812-4263889e3381 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:39.042617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1983af01-47c3-4ef3-9812-4263889e3381 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:39.043044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1983af01-47c3-4ef3-9812-4263889e3381 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:39.057460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:39.058191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:39.064538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:39.064988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:39.065751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:39.066181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:39.071453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1983af01-47c3-4ef3-9812-4263889e3381 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Jul 20 14:03:39.072018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 967/1736] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:03:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:39.196919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:39.204695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-14a34de7-839f-4480-8bc4-2a499a4622c7 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.151026 Jul 20 14:03:39.205271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 770/1737] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:39 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:39.782115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:39.782715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:39.788748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:39.789188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:39.789941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:39.790366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:39.850015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:39.857439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d6c41cc9-3b28-4672-98bf-7a9e282b5915 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079185 Jul 20 14:03:39.857992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 968/1738] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:40.083404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1a910c79-afe1-4c53-b59d-1a6a07d157ec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:03:40.084360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1a910c79-afe1-4c53-b59d-1a6a07d157ec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:40.086671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=76 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:40.091961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a910c79-afe1-4c53-b59d-1a6a07d157ec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:40.092443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a910c79-afe1-4c53-b59d-1a6a07d157ec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:40.093218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a910c79-afe1-4c53-b59d-1a6a07d157ec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:40.093657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a910c79-afe1-4c53-b59d-1a6a07d157ec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:40.174771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1a910c79-afe1-4c53-b59d-1a6a07d157ec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/action" status: 200 len: 76440 microversion: 2.1 time: 0.095355 Jul 20 14:03:40.175712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 771/1739] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 14:03:40 2022] POST /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d/action => generated 76440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 14:03:40.222438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:40.223039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:40.229895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:40.230347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:40.231096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:40.231523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:40.359398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:40.368551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4d72f456-89c5-4755-9aac-058978d690b1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.149941 Jul 20 14:03:40.369348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 969/1740] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:40 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:40.874902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:40.875593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:40.883180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:40.883630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:40.884420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:40.884856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:40.946341 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:40.954224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2cdfd111-ffae-4f88-842b-72f93e9cc9ac tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083595 Jul 20 14:03:40.954774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 772/1741] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:41.279050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:41.279557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:41.286082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.286533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:41.287305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.287745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:41.313303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:03:41.392642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d4593cef-f945-48b0-aa68-857bad2dfcac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 204 len: 0 microversion: 2.20 time: 0.117190 Jul 20 14:03:41.392887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:41.393370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 91b88a32-fbda-4e26-9d53-d40d22586cba] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:41.396678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 970/1742] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 14:03:41 2022] DELETE /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 14:03:41.400361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.400943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:41.401722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.402158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:41.402553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:41.403258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:41.409260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.409706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:41.410482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.410919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:41.536515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:41.544490 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:41.544958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cffa1de3-fe82-4e69-a79e-3d1c79dca7d1 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba" status: 200 len: 1737 microversion: 2.1 time: 0.163012 Jul 20 14:03:41.545532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 773/1743] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:41 2022] GET /compute/v2.1/servers/91b88a32-fbda-4e26-9d53-d40d22586cba => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:41.552953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:41.555076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:41.556253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f018f143-226f-465c-8999-31068c2b4967 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.158238 Jul 20 14:03:41.556806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 971/1744] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:03:41.561021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e3b62808-6a85-4d3b-8d7e-f50d2df34503 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '.version_select at 0x7fa40d308040>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:41.564117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3b62808-6a85-4d3b-8d7e-f50d2df34503 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [dc284c27-0665-4efb-8f7a-931e4dd1bd1e] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 14:03:41.972351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:41.972983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:41.979025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.979477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:41.980268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:41.980709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:42.046312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:42.049820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:42.056044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-218aaf0c-718b-4223-9317-9cbf90f9c221 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.087619 Jul 20 14:03:42.056655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 972/1745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:42.571492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3b62808-6a85-4d3b-8d7e-f50d2df34503 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [dc284c27-0665-4efb-8f7a-931e4dd1bd1e] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57974. Jul 20 14:03:42.574502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:42.575499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:42.584768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:42.585215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:42.585997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:42.586439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:42.593851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e3b62808-6a85-4d3b-8d7e-f50d2df34503 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-878887560" status: 202 len: 0 microversion: 2.1 time: 1.036386 Jul 20 14:03:42.594445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 774/1746] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 14:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-878887560 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:03:42.718506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:42.727614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:42.729212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:42.730470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3918ba47-6d9e-4a12-a1cb-7183e1ae534b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.159892 Jul 20 14:03:42.731046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 973/1747] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:43.073376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:43.074025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:43.079927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:43.080529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:43.081287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:43.081722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:43.177638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:43.185736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7c6d7862-6a1b-41b0-babb-3b6d71ed9db0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.116621 Jul 20 14:03:43.186318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 775/1748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:43.472064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-1005b40b-ccf4-419c-b41b-3ef22399b231 req-c183f0bb-a210-4c47-90c2-f303db2b38e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b88a32-fbda-4e26-9d53-d40d22586cba", "tag": "119533a5-579b-497a-b65d-fcd7a8d39cd6"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:03:43.480910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-1005b40b-ccf4-419c-b41b-3ef22399b231 req-c183f0bb-a210-4c47-90c2-f303db2b38e4 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:43.481353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-1005b40b-ccf4-419c-b41b-3ef22399b231 req-c183f0bb-a210-4c47-90c2-f303db2b38e4 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:43.492554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-1005b40b-ccf4-419c-b41b-3ef22399b231 req-c183f0bb-a210-4c47-90c2-f303db2b38e4 service nova] Creating event network-changed:119533a5-579b-497a-b65d-fcd7a8d39cd6 for instance 91b88a32-fbda-4e26-9d53-d40d22586cba on hv-cinder-81914 Jul 20 14:03:43.497836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-1005b40b-ccf4-419c-b41b-3ef22399b231 req-c183f0bb-a210-4c47-90c2-f303db2b38e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029542 Jul 20 14:03:43.498790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 974/1749] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:03:43.749545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:43.750447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:43.757555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:43.758051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:43.758830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:43.759267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:43.959944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:43.970391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:43.971904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:43.973080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3fcac35d-9f1a-4d4a-b620-3267ea4ea91a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.227692 Jul 20 14:03:43.973881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 776/1750] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:44.203431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:44.204230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:44.211292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:44.211731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:44.212523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:44.212949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:44.284602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:44.292398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f38d540b-f977-4f7a-baed-e2807c6377b7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.093108 Jul 20 14:03:44.292975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 975/1751] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:44.991782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:44.992901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:44.999250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:44.999688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:45.000465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:45.000894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:45.130714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:45.139599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:45.141128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:45.142263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4666f181-7684-4099-9c79-8936071d1aa4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154415 Jul 20 14:03:45.142816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 777/1752] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:45.310515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:45.311105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:45.317623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:45.318077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:45.318834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:45.319267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:45.384417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:45.391881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-70d75517-5596-47fe-82f7-1d358f65c215 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.085276 Jul 20 14:03:45.392485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 976/1753] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:46.161130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:46.161741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:46.168221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:46.168689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:46.169460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:46.169907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:46.295476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:46.304241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:46.305820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:46.306973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8e6885f7-3677-4e58-abe1-4804ec5307a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150056 Jul 20 14:03:46.307523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 778/1754] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:46.409090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:46.409731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:46.416255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:46.416679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:46.417448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:46.417881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:46.479315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:46.486765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3fb1682f-a68b-4a4d-ad4d-c77b41835986 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081609 Jul 20 14:03:46.487330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 977/1755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:47.324691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:47.325275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:47.331677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:47.332117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:47.333157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:47.333584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:47.459837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:47.468783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:47.470287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:47.471721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a390f7a4-a623-443c-b420-850cbdb86627 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151122 Jul 20 14:03:47.472318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 779/1756] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:47.502578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:47.503178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:47.509817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:47.510259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:47.511012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:47.511436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:47.571115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:47.578636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-abedc147-80ce-4b0b-b56f-869f310a245e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079750 Jul 20 14:03:47.579134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 978/1757] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:48.489738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:48.490335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:48.498015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:48.498464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:48.499220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:48.499649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:48.595942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:48.596667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:48.604098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:48.604581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:48.605360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:48.605795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:48.632703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:48.642545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:48.644141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:48.645326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fe42ad8b-7181-4f67-9b07-c861730743e9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.159431 Jul 20 14:03:48.655477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 780/1758] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:48.672537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:48.679967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fae6810d-ae93-46d7-8d24-dcf7d4475bb2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.087873 Jul 20 14:03:48.680559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 979/1759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:49.663343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:49.663950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:49.670967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:49.671415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:49.672177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:49.672638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:49.700999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:49.701614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:49.708514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:49.708963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:49.709732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:49.710350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:49.777595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:49.785309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b0fe8dde-234d-44c9-baf6-a6f62661f120 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.088148 Jul 20 14:03:49.785891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 980/1760] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:49 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:03:49.805943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:49.814262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:49.815773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:49.816983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2cff93fd-fd55-4c12-b1a7-c52ebf6c2ddd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157526 Jul 20 14:03:49.817546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 781/1761] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:50.802757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:50.803274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:50.810386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:50.810832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:50.811608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:50.812025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:50.835062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:50.835688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:50.842122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:50.842566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:50.843356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:50.843788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:50.874237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:50.881909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-65e3ed6a-c8e2-43b7-8f41-1b20d46f2553 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083150 Jul 20 14:03:50.882506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 981/1762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:50.974406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:50.977908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:50.984242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:50.985753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:50.986900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3849fdce-1235-4b58-a008-d5d9084a36cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155954 Jul 20 14:03:50.987459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 782/1763] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:03:51.898711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:51.899316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:51.906384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:51.906825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:51.907581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:51.908006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:51.969342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:51.976734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d6c60934-8b39-464b-ae58-83eccf1caf7f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081895 Jul 20 14:03:51.977290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 982/1764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:52.005402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:52.006017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:52.013102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:52.013572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:52.014324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:52.014752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:52.139447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:52.147823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:52.149432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:52.150528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d1a26631-1fcc-4588-a733-6d7719a8398c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148975 Jul 20 14:03:52.151079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 783/1765] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:52.993545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:52.994151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:53.001057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:53.001498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:53.002253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:53.002676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:53.066839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:53.074988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9be6a804-f8c4-46a4-9db4-b5b63eb4bea1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.085269 Jul 20 14:03:53.075551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 983/1766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:53.170162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:53.170800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:53.177327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:53.177781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:53.178546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:53.178986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:53.308587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:53.316900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:53.318410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:53.319559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-86f20efb-d995-4873-a1c9-c87de49981ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153985 Jul 20 14:03:53.320114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 784/1767] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:54.092660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:54.093301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:54.099737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:54.100210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:54.100991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:54.101427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:54.161290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:54.168658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b5261d8d-7f6b-4317-b196-46fc1a375284 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080441 Jul 20 14:03:54.169213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 984/1768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:54.337619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:54.338251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:54.344751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:54.345146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:54.345910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:54.346340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:54.472712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:54.481024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:54.482537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:54.483677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d3673153-c53b-4aa1-be48-ac49b1ee6971 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149908 Jul 20 14:03:54.484249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 785/1769] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:55.185400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:55.185998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:55.192651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:55.193104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:55.193934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:55.194370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:55.254886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:55.262262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-784b6347-4779-49c1-8afe-b10df3cdf3a9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080790 Jul 20 14:03:55.262819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 985/1770] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:55.501970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:55.502524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:55.508929 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:55.509371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:55.510637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:55.511061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:55.637708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:55.646171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:55.647688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:55.649018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89865691-114d-41a0-a21e-2beed93a40b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151015 Jul 20 14:03:55.649581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 786/1771] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:03:56.278933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:56.279613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:56.285964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:56.286407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:56.287165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:56.287596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:56.347439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:56.355301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e893ae05-b0af-4b51-ad62-8b30e323c336 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080246 Jul 20 14:03:56.355867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 986/1772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:56.667485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:56.668218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:56.674694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:56.675136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:56.675891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:56.676354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:56.808425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:56.816652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:56.818167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:56.819302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff534079-b8c7-4967-b14b-cb2c33806d36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156374 Jul 20 14:03:56.819859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 787/1773] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:57.372534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:57.373143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:57.379557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:57.380008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:57.380809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:57.381244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:57.445472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:57.453535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-07cbfd44-7c4d-46ea-bcf9-92f2d4fe1ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.085429 Jul 20 14:03:57.454094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 987/1774] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:57.837328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:57.838544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:57.845035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:57.845475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:57.846232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:57.846663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:57.973602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:57.981852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:57.983352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:57.984534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ae29d3bc-6a86-4967-be84-b261c480f50c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151311 Jul 20 14:03:57.985091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 788/1775] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:58.470410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:58.471020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:58.477458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:58.477902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:58.479147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:58.479576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:58.542073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:58.549435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9aa06ced-80a8-4f32-bba0-df0f9f14e639 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082877 Jul 20 14:03:58.549990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 988/1776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:03:59.002777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:59.003388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:59.009820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:59.010258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:59.011010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:59.011437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:59.145386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:59.154190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:59.155710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:59.156883 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-21ee9824-f927-4c76-90b0-be8a928854d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.158011 Jul 20 14:03:59.157427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 789/1777] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:03:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:03:59.565937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:03:59.566573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:03:59.573603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:59.574053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:59.574803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:03:59.575231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:03:59.637379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:03:59.645002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-81e3efb6-a17a-4a99-af5a-921d3a510e5f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082983 Jul 20 14:03:59.645778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 989/1778] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:03:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:00.174927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:00.175513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:00.182681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:00.183125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:00.183893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:00.184358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:00.312975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:00.321246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:00.322753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:00.323900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-954360c6-a5d2-4fc9-9694-5e4bb16a07e0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152925 Jul 20 14:04:00.324508 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 790/1779] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:00.661800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:00.662417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:00.668900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:00.669351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:00.670114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:00.670547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:00.674575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:00.731957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:00.739413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3f1d696c-8ed7-4dfc-b4bc-a239581ba840 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081563 Jul 20 14:04:00.739978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 990/1780] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:01.342434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:01.343030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:01.349478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:01.349922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:01.350673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:01.351101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:01.475751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:01.484615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:01.486166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:01.487429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9790725e-a410-4f24-82e7-892779de5746 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148895 Jul 20 14:04:01.487983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 791/1781] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:01.756437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:01.757008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:01.763499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:01.763943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:01.764743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:01.765172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:01.830701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:01.838916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-19365c6b-1047-4122-9cad-0a49a1363e56 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086498 Jul 20 14:04:01.839478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 991/1782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:01 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:02.506179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:02.506790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:02.514714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:02.515273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:02.516314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:02.516854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:02.649022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:02.657452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:02.659000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:02.660178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d50f919e-a518-42ab-9774-f78fb6d813ea tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157937 Jul 20 14:04:02.660761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 792/1783] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:02.856276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:02.856801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:02.863230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:02.863678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:02.864466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:02.864902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:02.924736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:02.932169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-669e91d3-5cff-45d7-ba52-25a3492855e6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079834 Jul 20 14:04:02.932761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 992/1784] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:03.678100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:03.678706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:03.685792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:03.686236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:03.686998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:03.687429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:03.813063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:03.821220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:03.822714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:03.823848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-38aa1d8f-6d6f-4479-afda-f20feb0963b3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149693 Jul 20 14:04:03.824440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 793/1785] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:03.948710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:03.949325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:03.955803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:03.956281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:03.957048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:03.957480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:04.017675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:04.025081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-990dc225-8a4e-40d5-9659-991340de833e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080185 Jul 20 14:04:04.026146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 993/1786] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:04.842083 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:04.842629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:04.849063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:04.849512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:04.850269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:04.850702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:05.042046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:05.042701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:05.049628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:05.050076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:05.050970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:05.051414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:05.116402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:05.124851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8b6e4bee-6ba6-4523-8d9d-7c3051f1ad1a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086758 Jul 20 14:04:05.125442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 994/1787] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:04:05.209981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:05.218359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:05.219880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:05.221052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a9ee4af8-7987-4e94-a127-8b063d1ac895 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.382960 Jul 20 14:04:05.221610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 794/1788] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:06.141639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:06.142242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:06.148735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:06.149182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:06.149947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:06.150381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:06.215596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:06.222982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e29d982e-827e-4623-bf31-1b5108aaba88 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.085202 Jul 20 14:04:06.223550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 995/1789] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:06.238774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:06.239412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:06.245877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:06.246351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:06.247110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:06.247542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:06.374934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:06.383471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:06.385012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:06.386181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-209947c5-e373-424f-8411-00ed865508a6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151243 Jul 20 14:04:06.386787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 795/1790] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:07.240444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:07.241115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:07.247947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:07.248439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:07.249194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:07.249624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:07.309302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:07.316700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c630933d-18dc-4232-b1df-a9119fbe102f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080184 Jul 20 14:04:07.317261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 996/1791] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:07.403955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:07.404621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:07.410986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:07.411435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:07.412280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:07.412653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:07.541526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:07.549831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:07.551328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:07.552502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-be624de3-3d0b-4df0-be16-e63c9a93fcbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152342 Jul 20 14:04:07.553057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 796/1792] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:08.334536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:08.335173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:08.342471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:08.342925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:08.343719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:08.344151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:08.405170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:08.412482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-64412865-4fd2-4c96-983e-4abaa8f2df1f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082157 Jul 20 14:04:08.413043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 997/1793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:08.571184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:08.571786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:08.579510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:08.579954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:08.580744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:08.581178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:08.713295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:08.721122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:08.722639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:08.723792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f3067acc-f68f-468b-ab52-2ea1b6d2e59a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156585 Jul 20 14:04:08.724387 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 797/1794] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:09.429458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:09.430071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:09.432452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:09.437786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:09.438231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:09.438996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:09.439519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:09.500710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:09.508040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-72299809-e04c-4567-9e1f-ec2e39ed1c28 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082539 Jul 20 14:04:09.508621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 998/1795] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:09.742047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:09.742564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:09.749076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:09.749524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:09.750290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:09.750727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:09.875716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:09.884101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:09.886191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:09.887339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-acff8d36-e4ee-4e7d-977f-a88eecd0aacb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149340 Jul 20 14:04:09.887903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 798/1796] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:10.525074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:10.525686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:10.532098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:10.532584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:10.533352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:10.533795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:10.597617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:10.605586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e8143b4c-bbc9-455a-8815-80f7a5b637db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084435 Jul 20 14:04:10.606149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 999/1797] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:10.906069 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:10.906672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:10.908953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:10.914202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:10.914642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:10.915396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:10.916492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:10.934981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:11.054733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:11.063122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:11.064651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:11.065788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61278bec-e56d-420f-a5f9-e04ee6ca3063 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.163587 Jul 20 14:04:11.066339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 799/1798] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:11.623202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:11.624719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:11.631825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:11.632495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:11.633724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:11.634424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:11.696926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:11.704875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6c2461c3-4867-4c49-adaf-6aacb8d92f36 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086480 Jul 20 14:04:11.705439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1000/1799] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:11 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:12.084034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:12.084674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:12.091089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:12.091529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:12.092304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:12.092730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:12.218580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:12.226888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:12.228983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:12.230124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-05db75c4-e43c-4a87-b846-30a1264a6a1e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150250 Jul 20 14:04:12.230808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 800/1800] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:12.721885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:12.722417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:12.728872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:12.729308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:12.730060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:12.730521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:12.792353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:12.799674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0356f3f5-2078-49fa-b5c3-da346060d7a7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081745 Jul 20 14:04:12.800237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1001/1801] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:13.249274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:13.249881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:13.256434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:13.256881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:13.257652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:13.258069 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:13.396775 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:13.405120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:13.406637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:13.407782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-79a6a15c-c398-4eb1-b7cf-d946a5e266d6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.162741 Jul 20 14:04:13.408479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 801/1802] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:13.816360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:13.816958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:13.823996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:13.824467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:13.825214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:13.825635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:13.885852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:13.893132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6fe830e1-58bb-4a24-8438-3223834b064e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080736 Jul 20 14:04:13.893687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1002/1803] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:14.426451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:14.427056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:14.434154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:14.434605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:14.435374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:14.435812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:14.563608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:14.571872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:14.573429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:14.574579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0de1c9a9-40f4-459a-a5fa-e7579192e5f1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152024 Jul 20 14:04:14.575139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 802/1804] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:14.910060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:14.910660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:14.917030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:14.917468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:14.918216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:14.918643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:14.982299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:14.989774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dd2e7152-01a8-4106-988b-11853ee7c833 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083509 Jul 20 14:04:14.990273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1003/1805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:15.593817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:15.594447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:15.601307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:15.601781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:15.602588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:15.603049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:15.782641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:15.790995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:15.792541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:15.793693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-797dce15-f0e6-45dd-9e91-b6408a5e2e5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.203994 Jul 20 14:04:15.794250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 803/1806] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:16.005833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:16.006446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:16.013559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:16.014008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:16.014778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:16.015212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:16.132770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:16.140845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e7b39ec5-2639-4155-906e-fa5a09f734ea tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.138870 Jul 20 14:04:16.141405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1004/1807] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:16.810966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:16.811481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:16.817888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:16.818332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:16.819088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:16.819520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:16.946714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:16.955141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:16.956676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:16.957830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-748fd436-e75c-49f4-abe7-31f7a13e3bf2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150920 Jul 20 14:04:16.958641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 804/1808] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:17.157710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:17.158329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:17.164366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:17.164815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:17.165583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:17.166022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:17.226313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:17.233801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f9fcc4c3-360a-4792-888d-701d36b4d0d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080175 Jul 20 14:04:17.234371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1005/1809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:17.975837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:17.976474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:17.983510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:17.983956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:17.984747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:17.985179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:18.111558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:18.120727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:18.122386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:18.123583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-58b6b11b-7520-453d-a15b-8bbfa6553a33 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151641 Jul 20 14:04:18.124139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 805/1810] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:18.250513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:18.251068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:18.257577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:18.258020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:18.258778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:18.259210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:18.318548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:18.321918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:18.327122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b8d44b45-c82c-4e7d-8c23-5f93c38834c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080580 Jul 20 14:04:18.327679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1006/1811] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:19.141615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:19.142268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:19.148699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:19.149139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:19.149894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:19.150983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:19.284331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:19.292901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:19.294402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:19.295549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0b612d8a-dc3d-4089-8c54-3907cb498471 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157806 Jul 20 14:04:19.296331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 806/1812] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:19.343912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:19.344622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:19.351410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:19.351861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:19.352659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:19.353097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:19.416401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:19.423956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-23adcea3-f62d-437a-817e-1652b63c1213 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083913 Jul 20 14:04:19.424555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1007/1813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:20.313912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:20.314564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:20.321321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:20.321790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:20.323159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:20.323615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:20.441136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:20.441745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:20.448987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:20.452654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:20.457844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:20.459164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:20.459619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:20.461513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:20.463070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:20.464281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6213c6ee-51da-4261-adc9-84775b201519 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154513 Jul 20 14:04:20.464872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 807/1814] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:20.523170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:20.530865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d6c35414-5bcc-4e32-8d05-aabcf446f109 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.093560 Jul 20 14:04:20.531430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1008/1815] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:21.482450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:21.483045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:21.489163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:21.489614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:21.490385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:21.490824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:21.549262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:21.549871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:21.556652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:21.557207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:21.558101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:21.558646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:21.620346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:21.625788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:21.628057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-784dd457-7805-4bf0-8f8e-6907dc7cc19a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082675 Jul 20 14:04:21.628683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1009/1816] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:04:21.634971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:21.636535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:21.637689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bd601460-f2a6-44b3-8ab4-122e40c202e2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.159155 Jul 20 14:04:21.638264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 808/1817] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:22.645385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:22.646135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:22.653254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:22.653696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:22.654456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:22.654882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:22.655149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:22.655757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:22.662248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:22.662700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:22.663469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:22.663910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:22.716142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:22.724003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d6b1f4a9-9c1e-4b2b-9e86-e905c49a3738 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082456 Jul 20 14:04:22.724605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1010/1818] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:22 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:22.790584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:22.798938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:22.800472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:22.801623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3b550f6e-5700-488e-9bec-d4ec2d611810 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150268 Jul 20 14:04:22.802177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 809/1819] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:04:23.740721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:23.741326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:23.747782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:23.748252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:23.749001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:23.749430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:23.811688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:23.819209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-716b1773-a54b-4c36-825f-a71b216715c5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082315 Jul 20 14:04:23.819768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1011/1820] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:23.820256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:23.821186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:23.828426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:23.828898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:23.829701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:23.830099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:23.960088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:23.969055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:23.970585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:23.971723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-579c4109-a39d-400d-ba0c-c7925c0fd8b4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156794 Jul 20 14:04:23.972291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 810/1821] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:04:24.836654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:24.837175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:24.843575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:24.844018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:24.844819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:24.845262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:24.904548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:24.911886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-758165b1-0c57-404d-bc61-ba9cdab575d9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079448 Jul 20 14:04:24.912488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1012/1822] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:24 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:24.989000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:24.989634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:24.997070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:24.997521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:24.998331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:24.998791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:25.124981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:25.133292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:25.134803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:25.135947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-425a2e94-776f-48af-81d5-238216b4cc92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151054 Jul 20 14:04:25.136545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 811/1823] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:25.928541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:25.929142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:25.936130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:25.936597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:25.937349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:25.937774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:25.998824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:26.006229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d3f2ca27-e782-467c-81ed-4e4ca7320cf7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081546 Jul 20 14:04:26.006777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1013/1824] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:26.154375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:26.154975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:26.161352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:26.161795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:26.162545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:26.162968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:26.293907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:26.302160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:26.303667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:26.304834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d27bd8c0-e18c-4219-8b39-ac37552c6039 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154849 Jul 20 14:04:26.305386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 812/1825] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:27.022985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:27.023580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:27.030018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:27.030456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:27.031209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:27.031634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:27.091500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:27.098960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-72b88596-53da-4927-b3bc-7729c88c8ed6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079834 Jul 20 14:04:27.099527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1014/1826] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:27.323655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:27.324222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:27.330648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:27.331098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:27.331866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:27.332342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:27.457892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:27.466491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:27.467991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:27.469150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1b1d6242-3240-4828-80b9-e9801c69ace3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149563 Jul 20 14:04:27.469709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 813/1827] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:28.116285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:28.116890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:28.123320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:28.123759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:28.124548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:28.124977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:28.189549 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:28.197420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3655d380-8a9d-4c8d-a333-6d29079d8444 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084496 Jul 20 14:04:28.197977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1015/1828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:28.486954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:28.487563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:28.494290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:28.494740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:28.495502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:28.495945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:28.622863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:28.631454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:28.633047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:28.634890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-26ff2f66-2cbe-4c28-b279-d4548224fe77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151148 Jul 20 14:04:28.635395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 814/1829] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:29.214543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:29.215132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:29.221883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:29.222330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:29.223086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:29.223517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:29.283733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:29.291125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe59405e-1cd5-4f6d-a517-3e9434dd4ee9 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080587 Jul 20 14:04:29.291682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1016/1830] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:29.653035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:29.653743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:29.660486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:29.660938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:29.661709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:29.662145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:29.792243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:29.800568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:29.802115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:29.803259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1b77984a-b497-46eb-8fa3-aaff037bb381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154194 Jul 20 14:04:29.803819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 815/1831] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:30.306785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:30.307393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:30.314313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:30.314760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:30.315522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:30.315955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:30.376468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:30.383797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d412c9fe-609d-4fc7-99cd-e849a0bb1f7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080847 Jul 20 14:04:30.384895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1017/1832] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:30.822505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:30.823110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:30.829588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:30.830033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:30.830793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:30.831223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:30.835343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:30.955924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:30.964593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:30.966105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:30.967259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-09ee564a-2b0e-47a5-bd6e-537f438fb94d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149392 Jul 20 14:04:30.967814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 816/1833] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:31.400388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:31.401003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:31.407561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:31.408007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:31.408819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:31.409258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:31.469446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:31.477064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-61b606cf-8765-4dbe-99c1-eb35ef3f8db5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080638 Jul 20 14:04:31.477628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1018/1834] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:31.986039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:31.986659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:31.993139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:31.993628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:31.994415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:31.994853 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:32.124972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:32.133260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:32.135369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:32.136554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b631b623-499e-423b-8ea8-ffef49b56a24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154539 Jul 20 14:04:32.137114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 817/1835] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:32.493341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:32.494588 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:32.501187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:32.501664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:32.502436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:32.502871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:32.567686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:32.575212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a2fd34bc-59ed-4a3f-843e-859067403ea6 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.085735 Jul 20 14:04:32.575780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1019/1836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:33.154480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:33.155062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:33.161438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:33.161875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:33.162625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:33.163052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:33.288395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:33.297180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:33.298794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:33.299962 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-115ad854-db35-4c1e-8c3c-1b13b0df10f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149364 Jul 20 14:04:33.300594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 818/1837] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:33.592900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:33.593459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:33.600001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:33.600481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:33.601250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:33.601686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:33.661530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:33.669151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3ecead79-0a4c-4917-b72c-6bedf2771070 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080232 Jul 20 14:04:33.669714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1020/1838] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:34.319220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:34.319827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:34.326940 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:34.327385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:34.328143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:34.328607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:34.454880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:34.463428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:34.464980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:34.466147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8e93ff8f-84ec-4b72-9615-61d201a30a9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151129 Jul 20 14:04:34.466681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 819/1839] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:34.686139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:34.686785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:34.693700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:34.694166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:34.694977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:34.695435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:34.759379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:34.770346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e7e00f19-ea22-45c3-b3da-725f7d70a934 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.088099 Jul 20 14:04:34.770960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1021/1840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:34 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:35.484296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:35.484893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:35.491307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:35.491748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:35.492520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:35.492947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:35.618693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:35.627123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:35.628699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:35.629869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-18362e01-2ab5-4ac8-8477-d6f1fe23cc12 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149506 Jul 20 14:04:35.630438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 820/1841] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:35.789151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:35.789718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:35.796756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:35.797200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:35.797958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:35.798391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:35.859110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:35.866512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7d5ebb97-f865-4bc9-830e-4a3426b9db4b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081280 Jul 20 14:04:35.867071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1022/1842] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:36.648375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:36.648990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:36.655937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:36.656421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:36.657194 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:36.657629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:36.798264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:36.806612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:36.808152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:36.809314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a9ce486c-fc9d-4786-8938-d38baa7f737c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.164900 Jul 20 14:04:36.809866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 821/1843] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:36.883162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:36.883766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:36.890210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:36.890649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:36.891408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:36.891833 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:36.910130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:36.956616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:36.965020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ce70ae7f-8490-4f47-9daa-cd72ab0fbb6a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.085737 Jul 20 14:04:36.965655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1023/1844] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:37.828277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:37.828963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:37.835566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:37.836007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:37.836783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:37.837209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:37.967747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:37.976121 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:37.977725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:37.978874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-70e37aef-8784-4918-84a0-7cbcf74ce068 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154539 Jul 20 14:04:37.979421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 822/1845] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:37.981757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:37.982398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:37.988974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:37.989423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:37.990190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:37.990623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:38.051305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:38.059362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-73d3d8ee-820f-4c29-8e02-e06d576e0409 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081500 Jul 20 14:04:38.059937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1024/1846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:04:38.996690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:38.997297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:39.003654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:39.004179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:39.004964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:39.005395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:39.076340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:39.076962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:39.083682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:39.084138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:39.084951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:39.085370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:39.139953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:39.150003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:39.152152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:39.153952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:39.155134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-484dba98-3e2f-45ed-8f73-889d6b374ccc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.162367 Jul 20 14:04:39.155703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 823/1847] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:39.160058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-23bc7722-544d-4e1f-94ca-188843ba11c4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.087672 Jul 20 14:04:39.160651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1025/1848] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:04:40.177527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:40.178118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:40.178496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:40.178607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:40.183036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=56 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:40.185275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:40.185769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:40.186550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:40.186742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:40.186978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:40.187197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:40.187977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:40.188443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:40.249709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:40.257233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bac5467c-0ee7-450c-bc99-92b36a7a07c0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083400 Jul 20 14:04:40.257799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1026/1849] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:04:40.317275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:40.325938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:40.327458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:40.328646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dbcfa25c-fbd3-40db-88cb-c2b2931e8eec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155014 Jul 20 14:04:40.329196 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 824/1850] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:04:41.274017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:41.274642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:41.281536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:41.281982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:41.282744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:41.283174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:41.345862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:41.347004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:41.347616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:41.349961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:41.353500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2944abb0-eb5a-4fbf-a35c-098d6165f771 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083293 Jul 20 14:04:41.354070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1027/1851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:41.356162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:41.356634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:41.357409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:41.357846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:41.482772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:41.491144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:41.492674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:41.493811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-120e19c9-93e1-4ae3-9236-e1ae0a81f7e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150830 Jul 20 14:04:41.494370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 825/1852] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:04:42.370688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:42.371288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:42.377953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:42.378395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:42.379154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:42.379583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:42.442203 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:42.449616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-59fd188c-b5f6-4e19-95d6-e9f518fe6485 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082812 Jul 20 14:04:42.450183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1028/1853] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:42 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:42.512817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:42.513445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:42.520692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:42.521367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:42.522333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:42.522846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:42.654956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:42.663295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:42.664863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:42.666015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1255134a-1ed1-4a3a-b7f0-12b29d43cd9c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157616 Jul 20 14:04:42.666620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 826/1854] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:43.467259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:43.467832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:43.474256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:43.474699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:43.475451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:43.475878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:43.536898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:43.544112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0200491d-dc66-46e1-8458-b1aa04365198 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081413 Jul 20 14:04:43.544688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1029/1855] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:43 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:43.684292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:43.684905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:43.691417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:43.691867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:43.692671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:43.693108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:43.818283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:43.827108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:43.828861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:43.830040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bed6ade3-772e-4e30-b3bb-4555af0d34d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150182 Jul 20 14:04:43.830601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 827/1856] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:44.560390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:44.561003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:44.567576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:44.568024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:44.568826 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:44.569261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:44.630729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:44.638216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9063c728-373e-40c4-ba25-b93809c65ec3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081745 Jul 20 14:04:44.638788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1030/1857] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:44 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:44.848873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:44.849422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:44.856075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:44.856556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:44.857321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:44.857757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:44.984609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:44.993005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:44.994521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:44.996211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-58acd5a6-c1d4-40dc-bb48-68fd3fada1a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151308 Jul 20 14:04:44.996774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 828/1858] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:45.655421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:45.656028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:45.662653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:45.663122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:45.663883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:45.664349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:45.727377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:45.734827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-135ba97f-d145-4b46-af91-c9e595c5ea67 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083790 Jul 20 14:04:45.735391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1031/1859] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:45 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:46.014778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:46.015380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:46.021798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:46.022247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:46.023003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:46.023435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:46.152659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:46.160899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:46.162399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:46.163530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b9a33558-0c77-483d-821a-d2e9c0a4242a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153239 Jul 20 14:04:46.164096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 829/1860] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:46.751529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:46.752071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:46.758591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:46.759037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:46.759805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:46.760272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:46.821071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:46.828958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1d7d1eb6-23e7-45a9-ade9-10ef80fd8985 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081347 Jul 20 14:04:46.829518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1032/1861] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:46 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:47.181303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:47.181908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:47.188398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:47.188843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:47.189604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:47.190035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:47.314111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:47.322371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:47.323874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:47.325060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3ec1327b-98bd-4cda-b1b0-3a96610e5ba3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.147654 Jul 20 14:04:47.325620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 830/1862] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:47.846209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:47.846819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:47.852955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:47.853401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:47.854158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:47.854587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:47.913309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:47.920702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4592e197-bde4-4280-949c-874d15197239 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.078358 Jul 20 14:04:47.921261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1033/1863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:47 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:48.343997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:48.344573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:48.351120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:48.351567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:48.352362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:48.352799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:48.482731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:48.491063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:48.492605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:48.493754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cd934218-3a53-4206-bbe1-12edd16ba71f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153788 Jul 20 14:04:48.494306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 831/1864] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:48.937374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:48.937987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:48.944408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:48.944853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:48.945613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:48.946043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:49.007146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:49.014655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17289e70-2239-49a7-a836-7baac6bb0271 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081197 Jul 20 14:04:49.015212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1034/1865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:48 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:49.512924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:49.513533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:49.520042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:49.520529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:49.521309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:49.521746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:49.646819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:49.650278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:49.656921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:49.658418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:49.659560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c04dbd64-dbac-4e0d-9932-bdc128b90c94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151182 Jul 20 14:04:49.660116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 832/1866] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:50.031882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:50.032547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:50.038932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:50.039378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:50.040145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:50.040604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:50.105057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:50.112482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d2beea29-074c-45ef-a462-37b078b3b2c3 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084443 Jul 20 14:04:50.113047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1035/1867] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:50 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:50.678276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:50.678884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:50.686017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:50.686467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:50.687231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:50.687663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:50.811628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:50.820032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:50.821579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:50.822720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b43e3329-fa63-4b2f-82a2-de13a41a9199 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148627 Jul 20 14:04:50.823278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 833/1868] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:51.129759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:51.130298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:51.137299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:51.137744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:51.138493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:51.138926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:51.202574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:51.210755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8e952247-fda6-41ea-91c3-6c3c34d6e9d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084857 Jul 20 14:04:51.211335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1036/1869] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:51 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:51.841480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:51.842092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:51.848579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:51.849031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:51.849793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:51.850235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:51.980895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:51.989186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:51.990708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:51.991851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-50a1193f-f2fe-497e-b267-d7109e399381 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154820 Jul 20 14:04:51.992443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 834/1870] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:52.228501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:52.229547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:52.236176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:52.236648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:52.237406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:52.237837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:52.297841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:52.305325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6053f006-3b11-4a4b-8a18-3a9ce12ba417 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080805 Jul 20 14:04:52.305889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1037/1871] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:52 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:53.010249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:53.010849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:53.017228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:53.017672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:53.018429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:53.018850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:53.145722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:53.154671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:53.156232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:53.157376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-28e51370-da06-4980-ace3-6551245a626f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151134 Jul 20 14:04:53.157934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 835/1872] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:53.322978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:53.323516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:53.329937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:53.330376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:53.331128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:53.331555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:53.391193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:53.399208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-07e52eaa-cb27-446f-84b7-69eba306a4d0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080122 Jul 20 14:04:53.399769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1038/1873] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:53 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:54.176098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:54.176746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:54.183174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:54.183615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:54.184397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:54.184822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:54.316892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:54.325763 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:54.327276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:54.328462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c8ee3b83-974f-4184-bdf1-5f8a516153a5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156164 Jul 20 14:04:54.329023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 836/1874] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:54.417275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:54.417886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:54.424431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:54.424879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:54.425646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:54.426081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:54.490258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:54.497640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-45e879c5-8def-4c0b-8e65-179942440104 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084740 Jul 20 14:04:54.498224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1039/1875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:54 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:55.346951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:55.347586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:55.354832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:55.355279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:55.356045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:55.356500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:55.482828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:55.491115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:55.492661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:55.493810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c3808384-29dc-426d-b5df-15bd44f71a4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150797 Jul 20 14:04:55.494362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 837/1876] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:55.514228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:55.514846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:55.521315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:55.521765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:55.522532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:55.522968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:55.527470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:55.583520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:55.591647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-522ce8e5-9524-4107-a5cd-533e2d3e755a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081286 Jul 20 14:04:55.592227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1040/1877] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:55 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:56.510911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:56.511515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:56.518166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:56.518608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:56.519362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:56.519791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:56.608702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:56.609327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:56.615862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:56.616342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:56.617116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:56.617551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:56.651324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:56.659930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:56.661487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:56.662657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f01498fc-2561-417c-a6fe-3bd08d7e3a35 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155726 Jul 20 14:04:56.663218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 838/1878] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:56.681297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:56.689962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-df1c8c07-f007-4585-8c26-d215528934ce tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084981 Jul 20 14:04:56.690596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1041/1879] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:56 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:04:57.681323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:57.681929 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:57.688944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:57.689390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:57.690152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:57.690584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:57.706949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:57.707563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:57.714246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:57.714694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:57.715500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:57.715936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:57.776905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:57.784759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0c4ae538-c6d5-4961-8cd6-bbb6548e7f4a tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081586 Jul 20 14:04:57.785340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1042/1880] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:57 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:04:57.819239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:57.828289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:57.829820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:57.830960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-821d7d8e-dd63-44a7-a74b-f6dbb85e8ea0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153602 Jul 20 14:04:57.831515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 839/1881] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:04:58.801934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:58.802581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:58.809695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:58.810146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:58.810911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:58.811345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:58.849171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:58.849780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:58.856987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:58.857440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:58.858217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:58.858650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:58.876967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:58.884404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-57164496-7ef2-4a67-944d-55a58c06e67f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086360 Jul 20 14:04:58.885167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1043/1882] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:58 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:04:58.986415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:58.995522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:58.997076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:58.998228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7f65d9de-1a47-40fe-b84a-48970bdf564e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152982 Jul 20 14:04:58.998795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 840/1883] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:04:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:04:59.901213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:04:59.901823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:04:59.908345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:59.908821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:59.909562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:04:59.909995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:04:59.969843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:04:59.977219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5f0bd34b-844c-4592-b8a8-eb0ee1281278 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079885 Jul 20 14:04:59.977776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1044/1884] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:04:59 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:00.017087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:00.017684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:00.023991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:00.024468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:00.025225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:00.025657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:00.155820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:00.164234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:00.165731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:00.167353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0fde3fbc-36de-4c39-a6a4-65b03cdb71ac tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153908 Jul 20 14:05:00.167903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 841/1885] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:00.993602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:00.994210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:01.000744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:01.001184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:01.001949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:01.002383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:01.063904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:01.071301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-67f9968b-e065-4d84-bef5-8c49c4acb823 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081592 Jul 20 14:05:01.071866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1045/1886] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:00 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:01.185572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:01.186243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:01.193656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:01.194267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:01.195042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:01.195481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:01.323707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:01.332038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:01.333579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:01.334988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-45c92241-0a17-4ac2-8315-7e3af36200ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153479 Jul 20 14:05:01.335543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 842/1887] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:02.088738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:02.089340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:02.095811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:02.096286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:02.097039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:02.097465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:02.156864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:02.164418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96a641fd-f562-46b3-b15d-305a62ce71a0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079482 Jul 20 14:05:02.164989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1046/1888] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:02 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:02.353662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:02.354185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:02.360688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:02.361139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:02.361904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:02.362348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:02.495799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:02.504089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:02.505645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:02.506822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e0e0436a-9876-4666-a1b7-542097e244c3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157139 Jul 20 14:05:02.507382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 843/1889] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:03.305264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:03.305878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:03.311869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:03.312423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:03.313182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:03.313771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:03.376243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:03.383722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fd173c4b-bc01-4251-bcf0-b4507d2edf9b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.206861 Jul 20 14:05:03.384309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1047/1890] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:03 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:03.524742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:03.525254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:03.532382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:03.532831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:03.533596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:03.534061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:03.659367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:03.667693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:03.669228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:03.670380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-20173bd1-9f79-4984-bd89-7ee8a120a8e8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149586 Jul 20 14:05:03.670935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 844/1891] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:04.400451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:04.401548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:04.407913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:04.408383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:04.409132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:04.409557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:04.470744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:04.478291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5f7d6b85-d81c-4e4c-98f1-b5711098d753 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081550 Jul 20 14:05:04.478710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1048/1892] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:04 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:04.688091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:04.688651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:04.695054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:04.695496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:04.696279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:04.696711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:04.821598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:04.830388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:04.831898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:04.833082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-87f33957-9a13-40ec-aa46-0de73a267c63 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149007 Jul 20 14:05:04.833650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 845/1893] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:05.495604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:05.496247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:05.502698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:05.503148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:05.503909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:05.504433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:05.564712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:05.572242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-91de900a-ad6f-48e2-8e6e-e7a61322c466 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080552 Jul 20 14:05:05.572805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1049/1894] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:05 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:05.851297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:05.851824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:05.858361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:05.858807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:05.859560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:05.859994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:05.987860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:05.996606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:05.998091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:05.999227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-860cd7e5-de13-4804-a132-e6759ac69423 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151948 Jul 20 14:05:05.999782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 846/1895] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:06.589117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:06.589722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:06.596070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:06.596541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:06.597295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:06.597725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:06.658035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:06.665570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-feb9e6cd-e3f5-400b-9311-be96b5fa3099 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080433 Jul 20 14:05:06.666134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1050/1896] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:06 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:07.017310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:07.019145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:07.024482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:07.024930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:07.025695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:07.026155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:07.154541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:07.162756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:07.164285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:07.165429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d6156e49-ab32-4060-b8a0-80aed4fc9372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152126 Jul 20 14:05:07.165986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 847/1897] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:07.682395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:07.683022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:07.689425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:07.689885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:07.690632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:07.691058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:07.754552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:07.762494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e8843dd5-d268-434c-b086-ceaeb2c1af4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083995 Jul 20 14:05:07.763053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1051/1898] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:07 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:08.184720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:08.185325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:08.191820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:08.192303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:08.193063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:08.193509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:08.323467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:08.332424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:08.334191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:08.335331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-161c86d9-d771-40f9-bceb-98b46b0941bf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154578 Jul 20 14:05:08.335881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 848/1899] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:08.779416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:08.779967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:08.786534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:08.786978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:08.787734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:08.788166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:08.850264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:08.857763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-99a9f037-7a01-456c-95e6-d4f99603fcf4 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083225 Jul 20 14:05:08.858331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1052/1900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:08 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:09.353915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:09.354512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:09.361117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:09.361561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:09.362317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:09.362750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:09.381236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:09.508630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:09.518676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:09.520183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:09.521383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-350a64da-2853-41f7-a5a8-ffcc71e68ec6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.171334 Jul 20 14:05:09.532704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 849/1901] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:09.875071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:09.875678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:09.882097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:09.882541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:09.883295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:09.883720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:09.944586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:09.951989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7086877f-adc0-4641-8076-9612f7c2848f tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080829 Jul 20 14:05:09.952583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1053/1902] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:09 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:10.540523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:10.541177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:10.547511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:10.547989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:10.548756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:10.549188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:10.683610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:10.691914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:10.693433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:10.694567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-de89c666-96a5-4b1c-b166-75f9b2dab182 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157990 Jul 20 14:05:10.695120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 850/1903] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:10.969000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:10.969608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:10.971894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=56 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:10.977502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:10.977954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:10.978746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:10.979725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:11.041206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:11.049066 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0168dfee-2bb6-4c82-b62b-aaea63635f03 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083929 Jul 20 14:05:11.049625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1054/1904] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:10 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:11.713080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:11.714260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:11.716542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:11.721969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:11.722415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:11.723176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:11.723606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:11.848016 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:11.856325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:11.857833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:11.858968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-497a9556-014d-456d-bd31-c261c8ea8e9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150016 Jul 20 14:05:11.859528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 851/1905] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:12.066303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:12.066912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:12.073945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:12.074394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:12.075156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:12.075591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:12.138489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:12.145777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b6fdc7a3-2a37-4f13-9fbf-f247d9a5bc7e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083388 Jul 20 14:05:12.146328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1055/1906] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:12 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:12.876956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:12.877470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:12.883903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:12.884370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:12.885120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:12.886156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:13.015300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:13.023557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:13.025085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:13.026221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6e6b213d-3608-4223-97f6-24e373dbf3a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153258 Jul 20 14:05:13.026776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 852/1907] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:13.163292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:13.164016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:13.171031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:13.171484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:13.172287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:13.172725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:13.234186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:13.237528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:13.242305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1f2a1eea-9f1c-4f08-b5a2-021498b9c9ec tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083642 Jul 20 14:05:13.242869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1056/1908] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:13 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:14.044772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:14.045383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:14.051786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:14.052260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:14.053032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:14.053463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:14.182808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:14.191126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:14.192662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:14.193837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0b7c1929-5090-4fc9-8947-e2477d51c7d4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153555 Jul 20 14:05:14.194395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 853/1909] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:14.263257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:14.263860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:14.270195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:14.270636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:14.271389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:14.271819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:14.331631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:14.339816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5aefc1c2-d594-4813-82b2-eec4ecdc892d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080548 Jul 20 14:05:14.340407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1057/1910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:14 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:05:15.212301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:15.212863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:15.219255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:15.219707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:15.220482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:15.220910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:15.357093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:15.357856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:15.360706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:15.364465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:15.364913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:15.365681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:15.366123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:15.371416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:15.373291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:15.374462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-69ec18a2-7465-4483-aaa4-7e8efbc9573e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.166378 Jul 20 14:05:15.375221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 854/1911] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:15.431069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:15.439085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d5ab5f14-cc83-41e3-a8fb-199910cecc27 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.086526 Jul 20 14:05:15.439649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1058/1912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:15 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:05:16.394827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:16.395435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:16.402524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:16.402966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:16.403726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:16.404154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:16.454861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:16.455473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:16.462241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:16.462690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:16.463989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:16.464454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:16.528268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:16.534708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:16.535877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4df1df3c-1821-4bb1-a26d-48ca5a859a59 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084828 Jul 20 14:05:16.536494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1059/1913] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:16 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:05:16.543742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:16.545269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:16.546414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-27a06f87-9f22-404d-9f8e-eb374790ed2a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155857 Jul 20 14:05:16.546964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 855/1914] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:17.553324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:17.553915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:17.560131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:17.560610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:17.561368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:17.561801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:17.564220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:17.564916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:17.571398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:17.571851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:17.572646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:17.573084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:17.622422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:17.630149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-038079c9-8741-4ef4-83a0-51ccc48383b0 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080888 Jul 20 14:05:17.630926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1060/1915] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:17 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:17.709744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:17.718722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:17.720227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:17.721368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2bee774a-5127-4240-96d9-e78ad132ab1b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.161209 Jul 20 14:05:17.721921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 856/1916] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:05:18.646847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:18.647464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:18.653978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:18.654424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:18.655184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:18.655615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:18.718110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:18.725366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9b6ebfa0-65ee-4b27-a12c-811067ce80c1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082394 Jul 20 14:05:18.725927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1061/1917] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:18 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:18.739780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:18.740424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:18.746817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:18.747267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:18.748031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:18.748521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:18.873471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:18.881644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:18.883142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:18.884304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-262ebcc2-b8bf-45db-91c9-9725f82e0d87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148371 Jul 20 14:05:18.884857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 857/1918] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:19.742777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:19.743397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:19.749829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:19.750308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:19.751116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:19.751555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:19.810949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:19.818441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96962698-f183-48db-9081-a7db08e25f0e tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079521 Jul 20 14:05:19.819002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1062/1919] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:19 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:19.903800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:19.904712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:19.911281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:19.911719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:19.912488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:19.912915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:20.041603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:20.050392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:20.051886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:20.053042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2de4a53f-2e46-4601-947d-6e3c6ebcacd8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154348 Jul 20 14:05:20.053587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 858/1920] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:20.836004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:20.836554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:20.842926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:20.843369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:20.844120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:20.844571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:20.907627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:20.914905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f8536925-6720-4aad-be62-e672bcc65a1c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083092 Jul 20 14:05:20.915457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1063/1921] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:20 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:21.071101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:21.071706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:21.078179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:21.078626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:21.079391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:21.079826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:21.207309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:21.215950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:21.218229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:21.219385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9daa9d90-3b8e-470b-9598-e20b86bd5a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152179 Jul 20 14:05:21.219953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 859/1922] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:21.932418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:21.933091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:21.940160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:21.940635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:21.941393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:21.941825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:22.002098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:22.009583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-180e9f7c-ae7c-4777-983e-a5bd0044efb5 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081035 Jul 20 14:05:22.010147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1064/1923] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:21 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:22.237899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:22.238419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:22.244846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:22.245290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:22.246045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:22.246479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:22.374977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:22.383284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:22.384824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:22.385965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9afdec8e-2475-4524-ad4d-0f1e929a256b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151992 Jul 20 14:05:22.386521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 860/1924] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:23.026443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:23.027059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:23.033472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:23.033916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:23.034671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:23.035109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:23.094714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:23.102076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4031ce6d-a6a7-4fdb-9ab0-c0a97b0f074c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079557 Jul 20 14:05:23.102631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1065/1925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:23 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:23.403837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:23.404473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:23.410960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:23.411410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:23.412176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:23.412634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:23.540379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:23.549796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:23.551313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:23.552512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-32e0a029-ec15-430d-92da-499a159830df tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152557 Jul 20 14:05:23.553069 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 861/1926] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:24.118850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:24.119465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:24.125938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:24.126451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:24.127242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:24.127797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:24.189069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:24.196327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-22c5d9f5-087c-4bc6-b844-c31e83928a7d tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081465 Jul 20 14:05:24.196886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1066/1927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:24 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:24.571770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:24.572417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:24.579972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:24.580480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:24.581272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:24.581709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:24.793165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:24.801532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:24.803038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:24.804207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-37d5bfc2-d3ee-45b3-8494-c82bd2d984bb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.236794 Jul 20 14:05:24.804788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 862/1928] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:05:25.213974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:25.214581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:25.221509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:25.221951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:25.222702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:25.223125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:25.285293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:25.292781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-88b15b84-bfdb-407c-9968-44c6a50ee608 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082671 Jul 20 14:05:25.293355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1067/1929] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:25 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:25.822764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:25.823396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:25.830381 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:25.830819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:25.831567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:25.831996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:25.958141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:25.967377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:25.968918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:25.970339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b2b39572-066c-4684-b4bc-b7d222a36f82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151519 Jul 20 14:05:25.970920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 863/1930] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:26.311253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:26.311788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:26.318191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:26.318629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:26.319378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:26.319847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:26.382166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:26.389482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ebc352d3-de50-4923-b968-b71780673f24 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082943 Jul 20 14:05:26.390047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1068/1931] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:26 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:26.988848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:26.989453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:26.997240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:26.997685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:26.998513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:26.998943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:27.128050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:27.136384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:27.138387 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:27.139535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3df02fde-d070-4c61-9afa-70ae99f3ec56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154612 Jul 20 14:05:27.140089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 864/1932] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:27.406911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:27.407518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:27.413956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:27.414401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:27.415158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:27.415596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:27.475437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:27.483778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9ced7458-73d8-4707-a8bb-881054e2762b tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081334 Jul 20 14:05:27.484388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1069/1933] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:27 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:28.156972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:28.157689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:28.163801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:28.164272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:28.165038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:28.165475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:28.298051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:28.306460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:28.308005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:28.309178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-36f6a019-8cf1-483a-8cf2-9104555fc18b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156316 Jul 20 14:05:28.309741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 865/1934] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:28.500381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:28.501102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:28.507470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:28.507915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:28.508708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:28.509136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:28.569788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:28.577512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-817a802f-8de8-4644-b305-d75df87352d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080970 Jul 20 14:05:28.578118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1070/1935] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:28 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:29.327864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:29.328479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:29.335252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:29.335692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:29.336474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:29.336900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:29.340831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:29.467269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:29.475520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:29.477046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:29.478181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6ccc13d9-1716-46da-9957-c92342a346cb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154801 Jul 20 14:05:29.478727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 866/1936] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:29.593988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:29.594622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:29.601205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:29.601646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:29.602398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:29.602827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:29.665927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:29.674278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a7c47229-7aba-4dd1-b855-e9e7735cb472 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083992 Jul 20 14:05:29.674931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1071/1937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:29 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:30.496881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:30.498012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:30.504463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:30.504915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:30.505683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:30.506120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:30.632977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:30.642058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:30.643655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:30.645002 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dc7c3024-1a20-419c-981c-49182d922474 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152026 Jul 20 14:05:30.645566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 867/1938] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:30.691862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:30.692496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:30.699229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:30.699676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:30.701143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:30.701575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:30.762167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:30.770608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-22b3faae-872a-4d8c-b96c-9ecad3977df7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082774 Jul 20 14:05:30.771169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1072/1939] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:30 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:31.663136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:31.663748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:31.670239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:31.670687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:31.671454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:31.671891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:31.786854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:31.787467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:31.793928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:31.794386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:31.795156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:31.795593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:31.800213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:31.808698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:31.810216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:31.811355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b6a55433-dd01-4a4a-8910-7c8c0da36e3f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152124 Jul 20 14:05:31.811914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 868/1940] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:31.813491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:31.857195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:31.864768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7d25bc57-d1e6-4323-91d9-be6521cb09db tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.081765 Jul 20 14:05:31.865348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1073/1941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:31 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:32.829917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:32.830453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:32.837167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:32.837616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:32.838380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:32.838847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:32.881380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:32.881977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:32.888354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:32.888799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:32.889554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:32.889978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:32.954015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:32.961887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0867e83e-334d-4c69-8ebf-74aca5fc95d7 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.084352 Jul 20 14:05:32.964657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1074/1942] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:32 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:05:32.971989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:32.980685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:32.982908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:32.984070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-12f34cfa-5e67-448a-a809-e3693c7314c6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.158229 Jul 20 14:05:32.984656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 869/1943] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:33.764636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:05:33.764832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:05:33.979626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:33.980263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:33.987225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:33.987677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:33.988477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:33.988911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:34.002981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:34.003590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:34.010012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:34.010463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:34.011292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:34.011730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:34.052331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:34.060533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e47f106a-a34a-4b01-b066-4dd6d9892a62 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083995 Jul 20 14:05:34.061104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1075/1944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:33 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:34.137672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:34.146086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:34.147601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:34.148777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b8b5e555-1599-4f5e-9a15-b82c0d6fe76b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149688 Jul 20 14:05:34.149335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 870/1945] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:05:34.284811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:05:34.284968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:05:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:05:35.078006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:35.078642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:35.085317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:35.085767 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:35.086522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:35.086949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:35.149093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:35.156868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2b92d56d-4061-43e3-a3df-68dccd3dad4c tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083453 Jul 20 14:05:35.157420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1076/1946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:35 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:35.166708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:35.167313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:35.173737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:35.174184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:35.174943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:35.175385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:35.303677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:35.312554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:35.314058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:35.315199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-15cdbcfe-6048-43d1-b577-a3ca4ea11723 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152306 Jul 20 14:05:35.315756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 871/1947] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:35.989540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:05:35.989744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:05:36.174517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:36.175130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:36.181643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:36.182094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:36.182855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:36.183287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:36.246129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:36.254151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2478ac84-bdc2-46f0-beb6-800a45b0b9d2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083531 Jul 20 14:05:36.254704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1077/1948] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:36 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:36.333742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:36.334717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:36.341212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:36.341655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:36.342419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:36.342857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:36.467789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:36.476225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:36.477726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:36.478869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d0596029-faf2-47ef-9c62-0a7a06f5b7b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149169 Jul 20 14:05:36.479419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 872/1949] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:37.271420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:37.272027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:37.278552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:37.279002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:37.279757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:37.280216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:37.340085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:37.347804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-24334302-78a1-4382-a134-2f6af41b7f17 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.080185 Jul 20 14:05:37.348447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1078/1950] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:37 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:37.497911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:37.498436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:37.505510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:37.505957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:37.506714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:37.507145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:37.633053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:37.641472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:37.642979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:37.644120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e9a9acb1-c0b4-44ee-8be7-d71d572760f9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150151 Jul 20 14:05:37.644701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 873/1951] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:38.364452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:38.365058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:38.371474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:38.371919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:38.372694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:38.373122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:38.435212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:38.443446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-69eb6d79-1478-4195-87be-1f02ab8c8ca2 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083352 Jul 20 14:05:38.444009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1079/1952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:38 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:38.662500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:38.663133 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:38.669661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:38.670107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:38.670864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:38.671298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:38.802188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:38.810377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:38.811862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:38.813023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0ad7e4dd-0208-45a8-85eb-c17c7ac4b4d8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154451 Jul 20 14:05:38.813753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 874/1953] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:39.460959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:39.461938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:39.468659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:39.469104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:39.469867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:39.470299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:39.533130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:39.540517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c7d8f69d-addd-414e-a9d5-c7ff960540d1 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.083649 Jul 20 14:05:39.541079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1080/1954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:39 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:39.831177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:39.831716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:39.838386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:39.838833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:39.839619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:39.840053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:39.964756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:39.973347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:39.974851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:39.976001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2993edc3-2e38-4d0a-9f81-d40c5260a7cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148913 Jul 20 14:05:39.976584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 875/1955] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:40.556647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:40.557248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:40.563593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:40.564034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:40.564818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:40.565239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:40.624659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:40.632836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c90c45f6-cae2-4183-a1b5-48ec6a3d9237 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.079986 Jul 20 14:05:40.633394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1081/1956] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:40 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:40.994448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:40.995047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:41.001412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:41.001848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:41.002624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:41.003044 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:41.131062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:41.139300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:41.140854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:41.142027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-37cb3607-55e8-4aa5-b911-294f341c2061 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151455 Jul 20 14:05:41.142591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 876/1957] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:05:41.649981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:41.650587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] [instance: 36f9c037-a55c-46c4-aae3-4929db5f0193] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:41.652891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=56 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:41.658087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:41.658528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:41.659278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:41.659711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:41.720732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257a55c6a7164a49a9b1ca60e2b8cf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:41.728524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9f18e452-68f1-469d-886f-08120fba0cab tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193" status: 200 len: 1213 microversion: 2.1 time: 0.082328 Jul 20 14:05:41.729094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1082/1958] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:05:41 2022] GET /compute/v2.1/servers/36f9c037-a55c-46c4-aae3-4929db5f0193 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:05:41.895285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d74d305c-4214-4f01-8c83-090ffa1b9b96 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] Calling method '.version_select at 0x7fa411a05e50>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:41.901005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:41.915817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d74d305c-4214-4f01-8c83-090ffa1b9b96 tempest-TestShelveInstance-1322644963 tempest-TestShelveInstance-1322644963-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444680273" status: 202 len: 0 microversion: 2.1 time: 0.025109 Jul 20 14:05:41.916369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 877/1959] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jul 20 14:05:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444680273 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:05:42.159666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:42.160364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:42.166365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:42.166814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:42.167565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:42.168000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:42.298347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:42.307437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:42.308970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:42.310120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-60f0c095-9c07-4349-953c-c3ec6e898b01 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154347 Jul 20 14:05:42.310675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1083/1960] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:43.328861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:43.329444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:43.336540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:43.337124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:43.338022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:43.338517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:43.584864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:43.594666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:43.596817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:43.598033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eb6c6436-0417-4119-b4aa-0375603bfa36 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.273340 Jul 20 14:05:43.598795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 878/1961] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:44.617878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:44.618495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:44.625178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:44.625568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:44.626334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:44.626769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:44.767513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:44.777691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:44.779224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:44.780437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-307bfb25-fdcc-4e80-98ea-e222470165e1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.166461 Jul 20 14:05:44.788875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1084/1962] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:45.799467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:45.800103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:45.806781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:45.807242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:45.808018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:45.808494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:45.937248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:45.946237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:45.947733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:45.948895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b3c04827-a4d1-4f91-97ba-3af39bc2a309 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153908 Jul 20 14:05:45.949449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 879/1963] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:46.966893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:46.967480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:46.974140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:46.974598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:46.975369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:46.975805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:47.117839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:47.127799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:47.129630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:47.130933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ac2afb86-fa58-4760-ad1b-267a3805cb7e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.167972 Jul 20 14:05:47.131499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1085/1964] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:48.151070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:48.151936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:48.159849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:48.160316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:48.161082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:48.161506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:48.365594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:48.379736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:48.381650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:48.382960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7a63eeae-0c8c-471d-9922-66942f272202 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.238484 Jul 20 14:05:48.384020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 880/1965] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:49.400857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:49.401555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:49.409446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:49.409952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:49.410720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:49.411236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:49.544486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:49.553218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:49.555221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:49.556457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f346b704-2a25-4e4a-80c8-2428d326ba91 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.159570 Jul 20 14:05:49.557021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1086/1966] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:50.576424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:50.577029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:50.583889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:50.584803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:50.585566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:50.585993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:50.717089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:50.725448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:50.726957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:50.728106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2a3a0dbd-6b69-44be-b02e-a1aad73bfd5e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155612 Jul 20 14:05:50.728697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 881/1967] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:05:51.746151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:51.746783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:51.753333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:51.753777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:51.754537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:51.754967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:51.885381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:51.893594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:51.895582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:51.896749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-49102ff2-b32e-409d-b195-e1c7f3f844de tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154554 Jul 20 14:05:51.897306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1087/1968] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:52.915272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:52.915874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:52.922359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:52.922796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:52.923543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:52.923973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:53.052584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:53.060797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:53.062301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:53.063438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-23a521b6-0152-44ce-ad0a-1cceaed07a27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152122 Jul 20 14:05:53.063985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 882/1969] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:05:54.082032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:54.082638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:54.090623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:54.091069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:54.091828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:54.092296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:54.218510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:54.227650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:54.229214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:54.230375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-191bccbe-24ab-426a-9b75-d5051ba55d83 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152310 Jul 20 14:05:54.230936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1088/1970] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:55.249075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:55.249676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:55.256089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:55.256570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:55.257330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:55.257761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:55.384782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:55.388236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:55.393970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:55.395466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:55.396631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f68e7a12-f39d-4f89-bc0e-3a68eecb330b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151462 Jul 20 14:05:55.397180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 883/1971] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:56.414952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:56.415566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:56.422041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:56.422477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:56.423222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:56.423662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:56.554942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:56.563218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:56.564748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:56.565890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-04bb1eeb-535f-4cfa-9ef0-b065b2891175 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155057 Jul 20 14:05:56.566449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1089/1972] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:57.584922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:57.585524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:57.592010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:57.592487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:57.593241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:57.593670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:57.724740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:57.733365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:57.734855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:57.736013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7343d0bc-3811-4ad0-99f6-ce8152e4781b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155390 Jul 20 14:05:57.736602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 884/1973] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:58.754619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:58.755221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:58.761751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:58.762137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:58.762891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:58.763320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:58.767247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:58.889816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:58.898549 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:58.900042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:05:58.901215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ccd4f6fe-5f0a-4821-b44f-ed64fc3e2f0d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150530 Jul 20 14:05:58.901768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1090/1974] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:05:59.920154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:05:59.920764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:05:59.927729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:59.928177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:05:59.928961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:05:59.929396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:00.055476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:00.063804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:00.065337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:00.066473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d169267a-8c4f-4da1-8985-6ed97d8e1b49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150285 Jul 20 14:06:00.067037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 885/1975] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:05:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:01.085399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:01.086004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:01.092639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:01.093087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:01.093845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:01.094278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:01.225644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:01.234045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:01.235543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:01.236732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1eb11dd4-05b5-4646-87df-4e73e7bd1f46 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156172 Jul 20 14:06:01.237281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1091/1976] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:02.257591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:02.258190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:02.264665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:02.265108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:02.265852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:02.266282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:02.395791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:02.404218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:02.405743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:02.406888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f69ddf5f-4840-42e1-bee1-3ac9baa90d41 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153188 Jul 20 14:06:02.407451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 886/1977] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:03.424876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:03.425487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:03.431927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:03.432422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:03.433187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:03.433624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:03.559501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:03.567901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:03.569444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:03.570608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-24437c3f-c370-49b6-b32a-b6cd5389edee tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149663 Jul 20 14:06:03.571163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1092/1978] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:04.588972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:04.589577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:04.595992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:04.596476 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:04.597236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:04.597665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:04.722216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:04.731093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:04.732631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:04.733778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-034326c2-0c78-48ef-977b-4a7082e905cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148706 Jul 20 14:06:04.734325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 887/1979] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:05.752524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:05.753127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:05.760216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:05.760687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:05.761442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:05.761873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:05.889788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:05.898017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:05.899509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:05.900682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4095260a-1408-406b-a81a-43a4518017d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152179 Jul 20 14:06:05.901239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1093/1980] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:06.918020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:06.918624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:06.925086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:06.925529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:06.926292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:06.927375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:07.055150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:07.063443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:07.064983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:07.066131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c8e44f95-0a01-470e-90c3-24f526a43270 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151982 Jul 20 14:06:07.066684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 888/1981] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:08.084824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:08.085431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:08.091946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:08.092423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:08.093180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:08.093608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:08.222099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:08.230975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:08.232499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:08.233639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c31f8048-06f5-4b02-8eca-07879c7ab9a0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153238 Jul 20 14:06:08.234196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1094/1982] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:09.252238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:09.252848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:09.259269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:09.259715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:09.260494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:09.260927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:09.386994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:09.396288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:09.397967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:09.399128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-152d3761-7daa-4a87-8687-e5964283883c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150800 Jul 20 14:06:09.399806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 889/1983] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:10.417395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:10.418074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:10.424376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:10.424819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:10.425595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:10.426021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:10.553844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:10.562450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:10.564063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:10.565229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dc61051d-1af9-4ab6-9c55-99c80f1cb978 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151727 Jul 20 14:06:10.565793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1095/1984] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:11.583208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:11.583795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:11.591120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:11.591570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:11.592372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:11.592821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:11.718412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:11.727268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:11.728894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:11.730041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c5903102-536c-4d56-bada-3cc11ec7d0b7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150781 Jul 20 14:06:11.730646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 890/1985] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:12.748723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:12.749500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:12.751905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=28 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:12.757283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:12.757733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:12.758494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:12.758926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:12.887259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:12.895669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:12.897747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:12.898880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-61bf2d8c-d7ae-4eb2-8f80-05351f394bd4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154037 Jul 20 14:06:12.899432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1096/1986] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:13.917397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:13.917999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:13.920273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:13.925519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:13.925966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:13.926716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:13.927139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:14.055964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:14.064221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:14.065708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:14.066850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-27c0feb1-02e2-41e9-afea-f730edf73a84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153907 Jul 20 14:06:14.067407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 891/1987] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:15.085344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:15.085939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:15.092900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:15.093344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:15.095054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:15.095054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:15.221947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:15.230879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:15.232550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:15.233710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0004d988-c7e2-40ab-bcd2-d607f606d96c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152619 Jul 20 14:06:15.234277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1097/1988] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:16.252408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:16.252957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:16.259987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:16.260465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:16.261232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:16.261669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:16.386544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:16.395164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:16.396723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:16.397873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9083b39f-23bc-4b58-b6c7-e9affa3d7092 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149520 Jul 20 14:06:16.398424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 892/1989] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:17.416198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:17.416817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:17.422799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:17.423249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:17.424015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:17.424477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:17.549346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:17.558190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:17.559698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:17.560888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96dd5822-7662-4476-898d-509c5f499e77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148767 Jul 20 14:06:17.561447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1098/1990] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:18.579109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:18.579718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:18.586492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:18.586946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:18.587710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:18.588145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:18.719048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:18.727994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:18.729535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:18.730675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8a68d4e4-1541-41dd-a024-b172b4151af8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155513 Jul 20 14:06:18.731228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 893/1991] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:19.749086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:19.749675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:19.756557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:19.757007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:19.757761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:19.758189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:19.889692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:19.899003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:19.900547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:19.901694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-01d795fd-92cd-4c37-9aaf-f93af35bcfc8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156490 Jul 20 14:06:19.902252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1099/1992] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:20.919131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:20.919734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:20.926356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:20.926803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:20.927561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:20.927985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:21.054250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:21.062687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:21.064220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:21.065372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3d545fe5-33e8-4fa7-b17d-7bbbc0476da4 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150126 Jul 20 14:06:21.065925 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 894/1993] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:22.084435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:22.085297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:22.091918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:22.092400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:22.093185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:22.093609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:22.220533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:22.229422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:22.230931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:22.232072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cf14e4b0-9dd9-415e-ae3b-c32a116f3554 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152102 Jul 20 14:06:22.232659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1100/1994] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:23.250028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:23.250636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:23.258030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:23.258497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:23.259275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:23.260002 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:23.399567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:23.408185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:23.409762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:23.410926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7b9b0568-d290-4ca1-98d0-3b8b5469d4f2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.164812 Jul 20 14:06:23.411518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 895/1995] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:24.429965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:24.430566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:24.437078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:24.437521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:24.438295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:24.438721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:24.567015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:24.575941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:24.577460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:24.578598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bce4796c-32fe-403e-aabf-30b4f820bc84 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153065 Jul 20 14:06:24.579150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1101/1996] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:25.597224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:25.597771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:25.604681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:25.605129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:25.605889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:25.606328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:25.879456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:25.887652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:25.889176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:25.890311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46f0e28a-c508-431c-895e-61b9179c432d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.297100 Jul 20 14:06:25.890854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 896/1997] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:26.908928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:26.909538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:26.916458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:26.916905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:26.917660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:26.918094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:27.044312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:27.052530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:27.054028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:27.055175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-770379a0-e6fa-41f8-8a43-5bd992e4add6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150187 Jul 20 14:06:27.055735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1102/1998] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:28.074058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:28.074669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:28.080682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:28.081126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:28.081882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:28.082314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:28.086407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=79 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:28.210727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:28.218998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:28.220515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:28.221652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0879d77a-4c31-4ebc-9692-ade9610a1c49 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152351 Jul 20 14:06:28.222191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 897/1999] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:29.239674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:29.240315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:29.246800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:29.247255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:29.248018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:29.248479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:29.251046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=77 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:29.377388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:29.386099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:29.387608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:29.388794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1c6101bb-4a09-4fca-8a5d-dc2f346c13ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153099 Jul 20 14:06:29.389347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1103/2000] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:30.407187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:30.407807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:30.414239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:30.414686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:30.415444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:30.416545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:30.553702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:30.561873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:30.563417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:30.564636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8955686a-4933-4672-b385-bfc5f5a72590 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.161232 Jul 20 14:06:30.565244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 898/2001] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:31.583206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:31.583849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:31.591172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:31.591621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:31.592413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:31.592876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:31.718814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:31.727082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:31.728632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:31.729771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96309398-3617-4693-a33f-222cc416349e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150501 Jul 20 14:06:31.730330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1104/2002] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:32.748001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:32.748629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:32.755087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:32.755530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:32.756318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:32.756751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:32.883371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:32.891790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:32.893320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:32.894460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b6d8fa2a-ed6d-4abd-a87d-84a9389f2b10 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150363 Jul 20 14:06:32.895007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 899/2003] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:06:33.912370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:33.913005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:33.919335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:33.919773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:33.920541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:33.920970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:34.050365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:34.059229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:34.060802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:34.061959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e4a3d8fe-4981-4ae7-b79a-ba6656300f24 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153528 Jul 20 14:06:34.062516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1105/2004] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:35.081438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:35.082128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:35.088928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:35.089383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:35.090152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:35.090590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:35.458915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:35.467972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:35.469533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:35.470811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aff1de3f-69e1-4bb7-a5f2-69e03a44e122 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.393253 Jul 20 14:06:35.471362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 900/2005] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:36.489435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:36.490041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:36.497210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:36.497651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:36.498408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:36.498840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:36.628322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:36.637049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:36.638372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:36.639550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5ae2e461-ac28-40e2-b7ee-4dc6b025a2ec tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153978 Jul 20 14:06:36.640087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1106/2006] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:37.657411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:37.658154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:37.664668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:37.665117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:37.666383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:37.666819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:37.797655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:37.805948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:37.807557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:37.808750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-199148fc-6455-428d-8752-f0ba0c357372 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155221 Jul 20 14:06:37.809305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 901/2007] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:38.826923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:38.827452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:38.833897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:38.834345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:38.835363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:38.835793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:38.963312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:38.971670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:38.973220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:38.974372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f45d3d3a-54c9-456a-b9c3-f6d3ae64094b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151533 Jul 20 14:06:38.974929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1107/2008] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:39.992824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:39.993432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:40.000506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:40.000960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:40.001728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:40.002166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:40.133583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:40.142575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:40.144091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:40.145276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2fcafa2e-5f9f-45b3-a1b9-f60acd09d220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156386 Jul 20 14:06:40.145827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 902/2009] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:41.164625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:41.165290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:41.171920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:41.172406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:41.173165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:41.173600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:41.302543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:41.310754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:41.312256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:41.313393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eb1147f1-e8e4-4bf6-9073-0572d6cd5876 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152697 Jul 20 14:06:41.313951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1108/2010] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:42.330780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:42.331386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:42.338150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:42.338596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:42.339432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:42.339867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:42.464573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:42.472761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:42.474295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:42.475428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9b2a0305-f842-40de-b489-80cb29d8001e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148530 Jul 20 14:06:42.475970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 903/2011] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:43.493803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:43.494344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:43.497336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=26 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:43.502865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:43.503316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:43.504078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:43.504621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:43.632069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:43.640578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:43.642077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:43.643221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-030adfb0-4f6a-4d0f-bf45-1bf52f6ee3d7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153481 Jul 20 14:06:43.643778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1109/2012] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:44.661224 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:44.661835 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:44.664112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=26 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:44.669595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:44.670046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:44.670902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:44.671340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:44.800157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:44.808543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:44.810605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:44.811851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-415d7c75-18d3-4350-91f3-15a390d1a8eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154536 Jul 20 14:06:44.812442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 904/2013] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:45.829870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:45.830485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:45.837587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:45.838043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:45.838824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:45.839259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:45.966883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:45.975143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:45.976673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:45.977814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-48fc9748-8111-4841-9cf3-1109aa9a0f75 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151946 Jul 20 14:06:45.978368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1110/2014] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:46.995015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:46.995621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:47.002659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:47.003109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:47.003899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:47.004376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:47.129729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:47.138477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:47.140238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:47.141374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1a3f423b-cec4-4b5d-8d5d-13aef306ef4c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150429 Jul 20 14:06:47.141927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 905/2015] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:48.160341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:48.160980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:48.167158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:48.167600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:48.168383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:48.168831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:48.297327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:48.305603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:48.307113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:48.308404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1e501273-d517-4d33-ac89-76cfb1814eb9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151944 Jul 20 14:06:48.309472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1111/2016] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:49.326810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:49.327449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:49.333902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:49.334355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:49.335379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:49.335816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:49.461257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:49.469706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:49.471216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:49.472406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8e307be3-769f-4075-9636-ea3f28bab508 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149470 Jul 20 14:06:49.472993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 906/2017] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:50.497735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:50.498339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:50.505144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:50.505632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:50.506573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:50.507062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:50.640419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:50.649099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:50.650612 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:50.651772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-610fd5b7-7edf-4dbc-ae0c-1371c73b4a8a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.158506 Jul 20 14:06:50.652372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1112/2018] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:51.669815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:51.670421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:51.676961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:51.677436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:51.678206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:51.678641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:51.807059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:51.815367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:51.816921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:51.818073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ccc9bcf1-1354-4d96-b120-1766018de9a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152180 Jul 20 14:06:51.818627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 907/2019] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:52.836731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:52.837267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:52.846014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:52.846460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:52.847215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:52.847650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:52.974813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:52.983866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:52.985444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:52.986583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5e902087-5ec2-4e9e-a29c-005b35615342 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154144 Jul 20 14:06:52.987140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1113/2020] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:54.004634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:54.005244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:54.011708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:54.012154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:54.012943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:54.013957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:54.142000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:54.150246 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:54.151739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:54.152909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-82cc2fc8-2025-4abd-ac99-ce2785c3fd61 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152197 Jul 20 14:06:54.153467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 908/2021] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:55.171495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:55.172092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:55.178511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:55.178951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:55.179699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:55.180130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:55.307715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:55.316164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:55.317793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:55.318973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-33a9e5db-f0d0-45e0-be67-94626a845a82 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151932 Jul 20 14:06:55.319556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1114/2022] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:56.337982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:56.338584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:56.345623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:56.346064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:56.346860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:56.347293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:56.475406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:56.483614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:56.485148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:56.486292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e46b41dd-59a8-49b7-84a9-647917a7e03b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152473 Jul 20 14:06:56.486839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 909/2023] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:57.506781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:57.507425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:57.514491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:57.514942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:57.515710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:57.516145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:57.645126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:57.653479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:57.655585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:57.656749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f5275a1b-c7f8-4804-8cb5-d19fe05ffd27 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153915 Jul 20 14:06:57.657297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1115/2024] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:58.674797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:58.675446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:58.681678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:58.682119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:58.682869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:58.683298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:58.686279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=78 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:58.809675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:58.818349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:58.819842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:58.821000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a5b4d166-9ad9-4770-ba52-558af41689aa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150124 Jul 20 14:06:58.821539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 910/2025] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:06:59.839138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:06:59.839748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:06:59.846930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:59.847377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:59.848137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:06:59.848601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:06:59.851086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=78 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:06:59.975815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:59.984053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:59.985569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:06:59.986704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c006b39c-f2eb-4a83-b1d6-f8c14b7d4b4d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151797 Jul 20 14:06:59.987255 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1116/2026] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:06:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:01.004778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:01.005400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:01.011854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:01.012338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:01.013109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:01.013548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:01.138363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:01.146522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:01.148164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:01.149323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f622308f-0867-4b12-8a8c-69cc9bddcb96 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148568 Jul 20 14:07:01.149865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 911/2027] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:02.167856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:02.168499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:02.175431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:02.175879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:02.176687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:02.177118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:02.303600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:02.313263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:02.314770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:02.316047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bb6b0360-50e8-4933-95cc-e2a63b0e9d20 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151973 Jul 20 14:07:02.317976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1117/2028] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:03.336320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:03.336948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:03.343318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:03.343762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:03.344548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:03.344981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:03.475040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:03.483846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:03.485386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:03.486533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f705e7e7-682f-4dc8-8999-cec87135ff6a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154407 Jul 20 14:07:03.487087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 912/2029] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:04.504790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:04.505395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:04.511873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:04.512353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:04.513108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:04.513539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:04.643291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:04.651749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:04.653276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:04.654923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0705d465-1561-4c46-888f-38065963eb9f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154194 Jul 20 14:07:04.655479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1118/2030] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:05.672602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:05.673239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:05.679861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:05.680378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:05.681149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:05.681609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:05.806953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:05.815838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:05.817388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:05.818535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7206f2a7-b71a-4fb0-a1c0-a2bfd1300756 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150028 Jul 20 14:07:05.819090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 913/2031] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:06.836711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:06.837247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:06.844265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:06.844719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:06.845485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:06.845919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:06.970761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:06.979016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:06.980536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:06.981673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9ec6a808-ca01-405e-b391-d034efc546ed tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149289 Jul 20 14:07:06.982290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1119/2032] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:07.999606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:08.000232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:08.006789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:08.007238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:08.008009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:08.008549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:08.138426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:08.146643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:08.148153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:08.149331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-52d31eb3-199b-4ab2-b786-88910e994220 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153652 Jul 20 14:07:08.149884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 914/2033] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:09.167897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:09.168543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:09.175517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:09.175970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:09.176762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:09.177195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:09.307802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:09.316109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:09.317646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:09.318795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3a392bca-b51f-4501-906a-e3377371213e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154840 Jul 20 14:07:09.319353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1120/2034] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:10.341695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:10.342293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:10.351195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:10.351648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:10.352547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:10.352986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:10.486347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:10.494732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:10.496269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:10.497983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a174146f-c608-40e3-80dd-9761812aab5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.159907 Jul 20 14:07:10.498538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 915/2035] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:11.516090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:11.516766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:11.523228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:11.523677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:11.524463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:11.524895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:11.651790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:11.660693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:11.662210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:11.663392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cd81be90-2415-4e36-9b0a-d1653054e3e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151280 Jul 20 14:07:11.663948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1121/2036] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:12.682076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:12.682685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:12.689848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:12.690297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:12.691099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:12.691536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:12.822413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:12.831114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:12.832703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:12.833916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-abda6482-4d13-464d-a885-ff32e409dafa tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155794 Jul 20 14:07:12.834496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 916/2037] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:13.853023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:13.853627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:13.855866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=26 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:13.861675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:13.862118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:13.862875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:13.863308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:13.989572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:13.997877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:13.999370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:14.000543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e9886c3a-a87d-4e62-8e8d-9d1512afbc56 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151363 Jul 20 14:07:14.001107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1122/2038] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:07:15.018868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:15.019480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:15.021812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=26 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:15.027275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:15.027727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:15.028524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:15.028965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:15.156586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:15.165087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:15.166657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:15.167801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0920848a-b0d0-4e4d-9f2a-8afcc8da4777 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152897 Jul 20 14:07:15.168393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 917/2039] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:16.186875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:16.187469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:16.194062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:16.194508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:16.195265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:16.195695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:16.323936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:16.332493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:16.333988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:16.335386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-deeb3eff-7573-48a4-b725-3c1e5f18b33a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152717 Jul 20 14:07:16.335939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1123/2040] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:17.353356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:17.353957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:17.360390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:17.360839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:17.361607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:17.362044 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:17.489298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:17.498691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:17.500417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:17.501643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b9a9aad0-a11f-453c-80e6-394acbfaaf3a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152205 Jul 20 14:07:17.502229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 918/2041] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:18.519930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:18.520558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:18.527017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:18.527469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:18.528256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:18.528695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:18.660974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:18.669486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:18.671007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:18.672152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a40df348-3a09-4fcb-aa72-c50e18ac1491 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156133 Jul 20 14:07:18.672720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1124/2042] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:19.690513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:19.691113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:19.697539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:19.697989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:19.698754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:19.699192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:19.835985 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:19.844626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:19.846148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:19.847310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-08c9cb93-95d9-4e67-9105-9836e4954863 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.161143 Jul 20 14:07:19.847888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 919/2043] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:20.865547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:20.866095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:20.872622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:20.873075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:20.873837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:20.874896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:21.006514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:21.015402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:21.016954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:21.018109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-19031f82-9385-4575-aab1-c5de3648ae08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156617 Jul 20 14:07:21.018671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1125/2044] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:22.036530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:22.037125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:22.043605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:22.044046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:22.044843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:22.045270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:22.170201 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:22.178874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:22.180385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:22.181524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-407b4664-055f-4c85-b529-68e49617f1ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148887 Jul 20 14:07:22.182071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 920/2045] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:23.200634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:23.201326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:23.208291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:23.208741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:23.209498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:23.210185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:23.339422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:23.347852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:23.349463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:23.350647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0881730e-031c-426c-b5cd-57a10c1eb158 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153883 Jul 20 14:07:23.351208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1126/2046] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:24.368739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:24.369367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:24.375903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:24.376393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:24.377166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:24.377600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:24.507030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:24.515367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:24.517425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:24.518583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dfb49bad-f547-48db-8871-506726f93943 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153812 Jul 20 14:07:24.519135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 921/2047] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:25.536450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:25.537055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:25.543498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:25.543947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:25.544882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:25.545311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:25.676652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:25.685257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:25.686764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:25.688455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40838cc5-0bed-4b41-a991-1a4e78f93371 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155923 Jul 20 14:07:25.689015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1127/2048] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:26.706873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:26.707472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:26.714129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:26.714569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:26.715356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:26.715804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:26.841924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:26.850101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:26.851612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:26.852782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-30f75441-a750-4353-a383-bd9724832025 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150307 Jul 20 14:07:26.853335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 922/2049] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:27.871805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:27.872463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:27.879353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:27.879795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:27.880705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:27.881344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:28.005282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:28.013689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:28.015192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:28.016381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e563319a-f35c-494a-a37b-298224ea8da2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.148916 Jul 20 14:07:28.016939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1128/2050] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:29.035603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:29.036211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:29.042188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:29.042631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:29.043387 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:29.043818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:29.046337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=78 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:29.173771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:29.182189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:29.183702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:29.184885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-04ef0ebb-642c-4a06-b285-14ecf126ce87 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154309 Jul 20 14:07:29.185442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 923/2051] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:30.202912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:30.203537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:30.210226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:30.210674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:30.211418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:30.211849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:30.214369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=78 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:30.337566 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:30.346458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:30.347944 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:30.349091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a3620e5a-e099-4c90-9e21-b91276e598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150074 Jul 20 14:07:30.349649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1129/2052] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:31.367621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:31.368371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:31.374641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:31.375671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:31.376487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:31.376919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:31.502999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:31.511554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:31.513089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:31.514220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-17ca394f-cfd7-4f22-8a35-8b6ee0305707 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150521 Jul 20 14:07:31.514764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 924/2053] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:32.532266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:32.533568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:32.540502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:32.540947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:32.541706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:32.542169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:32.688810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:32.697170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:32.698684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:32.699835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b8cb6b4c-fbf3-4ef3-908a-a221c779b44b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.171540 Jul 20 14:07:32.700431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1130/2054] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:33.718478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:33.719657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:33.726212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:33.726661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:33.727575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:33.728015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:33.854748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:33.863249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:33.864868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:33.866012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0099eb99-d916-439f-867d-22fa8f6b7354 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151494 Jul 20 14:07:33.866560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 925/2055] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:34.884524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:34.885064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:34.892030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:34.892520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:34.893287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:34.893721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:35.018670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:35.026971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:35.028497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:35.029638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bcba5fea-6242-4327-a978-16783a5bda92 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149131 Jul 20 14:07:35.030290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1131/2056] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:36.048180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:36.048848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:36.055205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:36.055649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:36.056434 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:36.056861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:36.186388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:36.195105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:36.196645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:36.197796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-adbb2e99-de99-4944-b292-f0fcb1da72b6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153496 Jul 20 14:07:36.198346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 926/2057] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:37.225080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:37.225699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:37.232132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:37.232614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:37.233382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:37.233816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:37.361519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:37.369813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:37.371309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:37.372476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-628cb267-3ff0-4131-9f70-bdd4d29796a2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151298 Jul 20 14:07:37.373032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1132/2058] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:38.390607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:38.391265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:38.397803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:38.398244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:38.398994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:38.399425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:38.524344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:38.533138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:38.534645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:38.535789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ec72aaf1-3adb-4a37-a4f1-1570f591fdab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149108 Jul 20 14:07:38.536362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 927/2059] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:39.553559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:39.554172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:39.560829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:39.561279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:39.562042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:39.563679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:39.694643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:39.703515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:39.705043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:39.706184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-72e93b7c-8153-4ab1-84a2-404b40e37681 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156563 Jul 20 14:07:39.706737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1133/2060] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:40.725542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:40.726191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:40.733746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:40.734842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:40.735603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:40.736029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:40.874513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:40.883108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:40.884631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:40.885775 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cdcef37a-822d-4cd8-86fa-254575e5f9f3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.164145 Jul 20 14:07:40.886320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 928/2061] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:41.641579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:41.642071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:41.649146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:41.649739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:41.650545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:41.650979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:41.678488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:07:41.752158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5a18669e-98b5-4d7c-afe5-943b56c7da68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 204 len: 0 microversion: 2.1 time: 0.114946 Jul 20 14:07:41.752769 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1134/2062] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:07:41 2022] DELETE /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:07:41.761609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:41.762222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:41.768729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:41.769176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:41.769945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:41.770377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:41.897924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:41.904880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:41.905575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:41.905837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-85bd3476-6b47-44da-adde-9102d4fa6070 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148032 Jul 20 14:07:41.906412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 929/2063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:41 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:41.911482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:41.911918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:41.912708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:41.913137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:42.038742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:42.047866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:42.049410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:42.050562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a9122f29-d4f9-4f29-a4ac-e86a2c88d23a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150044 Jul 20 14:07:42.051122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1135/2064] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:07:42.923216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:42.923796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:42.930165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:42.930607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:42.931358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:42.931787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:43.056341 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:43.064253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-48fa0746-ea3a-488a-aa23-7c71380432ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145396 Jul 20 14:07:43.072063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 930/2065] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:42 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:43.072270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:43.072270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:43.075444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:43.075965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:43.076746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:43.077179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:43.434014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:43.442269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:43.443701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:43.444864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a3f05738-375a-4e15-83cf-36c144af267d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.380337 Jul 20 14:07:43.445422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1136/2066] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:07:44.081248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:44.081843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:44.088610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:44.089053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:44.089806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:44.090233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:44.219252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:44.227027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-30a5cca9-f946-4521-926e-70d00e82dcc6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149670 Jul 20 14:07:44.227575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 931/2067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:44 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:44.463160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:44.463829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:44.466240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:44.472063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:44.472545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:44.473309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:44.473747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:44.600604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:44.609626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:44.611145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:44.612325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9c90a372-d36a-4d0b-a324-e9bdd56f10fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153306 Jul 20 14:07:44.612879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1137/2068] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:45.243753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:45.244386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:45.246658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=30 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:45.251877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:45.252496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:45.253290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:45.253726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:45.379359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:45.387189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-df7baaa1-1737-419e-9265-77c62a326dcd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147312 Jul 20 14:07:45.389696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 932/2069] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:45 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:45.630390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:45.630921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:45.637815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:45.638257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:45.639020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:45.639445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:45.770483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:45.778796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:45.780332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:45.781532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8c752a69-67b6-4550-b606-3842533b4d94 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155200 Jul 20 14:07:45.782098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1138/2070] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:46.405855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:46.406443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:46.412870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:46.413315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:46.414076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:46.414504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:46.543077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:46.551501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cd7a19f5-1e25-42ad-a281-3468d3e3a806 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149511 Jul 20 14:07:46.552058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 933/2071] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:46 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:46.800224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:46.800828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:46.807188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:46.807633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:46.808423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:46.808854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:46.942556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:46.950720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:46.952240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:46.953915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ed81dcea-02a5-4685-8341-755c924d7fbf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.158289 Jul 20 14:07:46.954535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1139/2072] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:47.569171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:47.569779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:47.576245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:47.576691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:47.577454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:47.578516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:47.703681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:47.711822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-adb4f7a9-479b-4d10-8d5a-a790d41f4369 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146571 Jul 20 14:07:47.712411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 934/2073] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:47 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:47.972351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:47.972951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:47.978877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:47.979310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:47.980055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:47.980506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:48.145126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:48.153405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:48.154913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:48.156054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-198be526-d6bf-4069-9a86-1fc5a8f24fe6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.188336 Jul 20 14:07:48.156653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1140/2074] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:48.728870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:48.729392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:48.736330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:48.736780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:48.737548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:48.737986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:48.871233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:48.879134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8a28cda5-5ba5-43f1-981a-11200e6883e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154271 Jul 20 14:07:48.879702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 935/2075] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:48 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:49.174039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:49.174678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:49.181169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:49.181620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:49.182380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:49.182817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:49.310229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:49.318673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:49.320179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:49.321356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9919835f-04da-45a7-9060-2cce8aa66ee2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151249 Jul 20 14:07:49.321919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1141/2076] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:49 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:49.896915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:49.897535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:49.903954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:49.904435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:49.905191 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:49.905619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:50.038774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:50.047168 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5d22eeca-9421-4e3b-b566-78588540e68c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153573 Jul 20 14:07:50.047741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 936/2077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:49 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:50.340383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:50.340923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:50.348049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:50.348532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:50.349300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:50.349863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:50.481020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:50.489980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:50.491491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:50.492702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-42dde19a-ce65-4c0f-a1a5-1b6faf155a02 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156319 Jul 20 14:07:50.493264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1142/2078] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:51.064319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:51.064931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:51.071314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:51.071758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:51.072539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:51.072968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:51.199866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:51.208302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-17522797-78c3-4ecc-9123-03ed658a4f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148309 Jul 20 14:07:51.208856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 937/2079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:51 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:51.510793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:51.511391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:51.517746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:51.518190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:51.518938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:51.519363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:51.645535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:51.653919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:51.655386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:51.656550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-252865ca-5b17-4701-a28a-06c550d468fc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149633 Jul 20 14:07:51.657111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1143/2080] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:52.225658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:52.226270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:52.232815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:52.233266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:52.234031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:52.234468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:52.362769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:52.370857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-015dc93a-516a-4492-8733-130aada49a6a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149059 Jul 20 14:07:52.371429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 938/2081] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:52 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:52.674470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:52.675110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:52.681711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:52.682154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:52.682908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:52.683336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:52.687159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:52.811573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:52.820433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:52.821926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:52.823076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-865848c2-0c4b-4b14-938d-cb2f02236a88 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152502 Jul 20 14:07:52.823632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1144/2082] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:53.388037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:53.388673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:53.396063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:53.396568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:53.397334 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:53.397770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:53.523704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:53.525901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:53.533315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-27ca806c-fd5a-4f47-ad8e-6f0899bae9cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149294 Jul 20 14:07:53.533880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 939/2083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:53 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:53.842113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:53.842736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:53.849338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:53.849789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:53.850549 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:53.850984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:53.990526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:53.998715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:54.000277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:54.001411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5298d88c-9231-48ed-bbcd-7acbdb82a33c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.163285 Jul 20 14:07:54.001965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1145/2084] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:54.549759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:54.550360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:54.557043 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:54.557519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:54.558282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:54.558713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:54.689621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:54.697442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-543d1932-f4a3-49d8-b7cb-734b737d5d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151508 Jul 20 14:07:54.697995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 940/2085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:54 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:55.020025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:55.020677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:55.027107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:55.027570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:55.028444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:55.028885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:55.161598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:55.169814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:55.171298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:55.172973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9bc018d1-732a-450b-ba43-2596093fc6e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156938 Jul 20 14:07:55.173517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1146/2086] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:55 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:55.715762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:55.716413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:55.723593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:55.724046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:55.724847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:55.725285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:55.851444 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:55.859324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bd2a5f2a-c43f-4c9c-a008-7a1ad85733e6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147371 Jul 20 14:07:55.859885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 941/2087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:55 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:56.191403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:56.192017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:56.198681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:56.199134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:56.199895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:56.200370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:56.327762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:56.336980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:56.338490 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:56.339641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-985d68bb-f0b8-4a13-bff8-02e28f2b334a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152614 Jul 20 14:07:56.340212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1147/2088] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:56.876596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:56.877721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:56.884079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:56.884548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:56.885302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:56.885733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:57.015137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:57.022931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46dbde9b-c85d-4ac1-82f9-60618faebaab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150318 Jul 20 14:07:57.023489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 942/2089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:56 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:57.357822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:57.358425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:57.365096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:57.365543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:57.366291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:57.366721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:57.492010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:57.500334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:57.501950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:57.503099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6cba3d2c-c985-44ff-bf9c-d77221633f2f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149204 Jul 20 14:07:57.503656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1148/2090] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:58.039603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:58.040234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:58.046373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:58.046829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:58.047592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:58.048024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:58.175173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:58.182943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bac6c6dc-ea85-4667-9140-0f5433c3ac43 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147192 Jul 20 14:07:58.183525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 943/2091] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:58 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:58.522345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:58.523035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:58.529586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:58.530035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:58.530822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:58.531292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:58.658418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:58.666704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:58.668232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:58.669523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0fb35b3c-93ac-4aa9-8081-62d37561aa90 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151716 Jul 20 14:07:58.670086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1149/2092] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:07:59.200746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:59.201361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:59.207790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:59.208271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:59.209041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:59.209478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:59.334513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:59.342649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4eca2b0f-2b14-48c9-a6ae-51c23289c5dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145757 Jul 20 14:07:59.343218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 944/2093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:07:59 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:07:59.688562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:07:59.689163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:07:59.696182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:59.696646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:59.697398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:07:59.697823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:07:59.828134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:59.837728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:59.839273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:07:59.840530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-49c3046b-e032-4cb3-a106-95c6765e84c8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155724 Jul 20 14:07:59.841115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1150/2094] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:07:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:00.360282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:00.360876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:00.367500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:00.367955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:00.368831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:00.369271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:00.497991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:00.506438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1d34142c-32ee-40c7-a227-36c12c8236d0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150048 Jul 20 14:08:00.507007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 945/2095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:00 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:00.859724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:00.860387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:00.866808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:00.867269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:00.868010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:00.868483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:00.994709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:01.004012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:01.005570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:01.006713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-53151a01-966f-43f1-8030-8acc454ff75f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150877 Jul 20 14:08:01.007260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1151/2096] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:01.524088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:01.524722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:01.531161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:01.531605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:01.532391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:01.532826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:01.658815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:01.666665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61581d4b-6bc0-4d29-889b-fdfcfbbd4ff3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146444 Jul 20 14:08:01.667232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 946/2097] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:01 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:02.024987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:02.025620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:02.032065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:02.032538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:02.033283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:02.033709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:02.170419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:02.170748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:02.172280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:02.173432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-94b26fce-c6a6-4440-9391-163bd78eb83f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152399 Jul 20 14:08:02.174495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1152/2098] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:02 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:02.682784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:02.683427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:02.689916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:02.690363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:02.691125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:02.691559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:02.820159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:02.828020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eabfdb81-8cf8-4905-b6d9-3daeba5a6c84 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149117 Jul 20 14:08:02.828608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 947/2099] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:02 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:03.190968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:03.191592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:03.198077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:03.198526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:03.199280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:03.199713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:03.331380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:03.339960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:03.341497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:03.342636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8aefb45c-e481-4df5-bc9d-b477b8a7c108 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155525 Jul 20 14:08:03.343191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1153/2100] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:03.849397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:03.850920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:03.857675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:03.858124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:03.858900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:03.859336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:03.989937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:03.997769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c4cb735a-5e4e-4c86-a192-0e5fb0ccbca0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.155234 Jul 20 14:08:03.998328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 948/2101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:03 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:04.361195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:04.361752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:04.368162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:04.368685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:04.369440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:04.369873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:04.497064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:04.505945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:04.507446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:04.509043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0e854d7b-b1ae-46a7-bd0f-ea2a23faf9a8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151550 Jul 20 14:08:04.509609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1154/2102] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:05.015176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:05.015793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:05.022374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:05.022828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:05.023595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:05.024038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:05.160134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:05.168556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-04f3d749-8902-4bd9-99d3-a8f7944121bf tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.157224 Jul 20 14:08:05.169134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 949/2103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:05 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:05.526888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:05.527530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:05.534055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:05.534501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:05.535258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:05.535693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:05.664460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:05.672902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:05.674898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:05.676039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-48a72272-930e-407e-b54f-161b6d22114a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153088 Jul 20 14:08:05.676637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1155/2104] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:06.185768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:06.186357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:06.192813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:06.193251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:06.194004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:06.194435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:06.323292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:06.331739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aa36f459-48c7-46d7-83f0-87deb782be3e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149912 Jul 20 14:08:06.332315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 950/2105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:06 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:06.694686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:06.695287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:06.701846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:06.702290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:06.703042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:06.703473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:06.829504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:06.838719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:06.840276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:06.841420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ea4260d5-3f11-475f-ba95-40aabc7ba336 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150593 Jul 20 14:08:06.841983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1156/2106] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:07.348810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:07.349407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:07.355833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:07.356318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:07.357089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:07.357525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:07.481981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:07.490364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-538e633e-9d44-4a05-89af-ea5c635e2f2e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145448 Jul 20 14:08:07.490920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 951/2107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:07 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:07.860409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:07.861022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:07.867430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:07.867902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:07.868710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:07.869148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:07.997597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:08.005960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:08.007463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:08.008644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b1f99d0d-6f15-4795-abce-b865f5ed6edf tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152160 Jul 20 14:08:08.009208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1157/2108] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:08.507263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:08.507868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:08.514307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:08.514747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:08.515498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:08.515927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:08.654946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:08.662738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-394a0ce4-086e-4a31-9091-6e920aeabe0a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.159353 Jul 20 14:08:08.663294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 952/2109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:08 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:09.026823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:09.027457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:09.034446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:09.034890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:09.035642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:09.036074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:09.162702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:09.171218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:09.172763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:09.173915 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-25226538-35ae-458e-98e0-794c6ebff366 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150942 Jul 20 14:08:09.175119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1158/2110] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:09 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:09.678833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:09.679436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:09.685927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:09.686370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:09.687119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:09.687547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:09.813309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:09.821579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e0a573a4-a9b3-4043-ada9-7e39305fc587 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146605 Jul 20 14:08:09.822143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 953/2111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:09 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:10.193305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:10.194041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:10.200664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:10.201116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:10.201941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:10.202384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:10.336961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:10.345462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:10.346961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:10.348112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e3e8ee24-47a2-4ada-b043-1fb8c4b43045 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.159374 Jul 20 14:08:10.348706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1159/2112] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:10.839622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:10.840232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:10.847259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:10.847710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:10.848507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:10.848945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:10.976259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:10.984346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2cec8662-8d8d-4b7c-8674-a7b8a3081e46 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149025 Jul 20 14:08:10.984912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 954/2113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:10 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:11.365481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:11.366122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:11.372692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:11.373145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:11.373905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:11.374366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:11.500503 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:11.503182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:11.510604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:11.512183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:11.513355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-56e279a5-289c-43ee-bede-f671f0f64cb8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151801 Jul 20 14:08:11.513959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1160/2114] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:12.001398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:12.002032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:12.008459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:12.008900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:12.009653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:12.010078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:12.140477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:12.148525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a428f53c-cb58-45d5-8361-83299f4d44d1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150934 Jul 20 14:08:12.149132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 955/2115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:11 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:12.531776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:12.532416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:12.539199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:12.539791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:12.540482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:12.541166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:12.671169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:12.680121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:12.681675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:12.682821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5ffae82d-021a-46fd-b849-9f890735f179 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154944 Jul 20 14:08:12.683384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1161/2116] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:13.165781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:13.166394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:13.172829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:13.173281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:13.174531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:13.174961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:13.190237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:13.302802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:13.310677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d752d67e-294c-461a-842e-dec5154d11b3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148812 Jul 20 14:08:13.311237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 956/2117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:13 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:13.701655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:13.702293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:13.708773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:13.709219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:13.709971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:13.710665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:13.839669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:13.848673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:13.850180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:13.851346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-85fdf50b-b8f4-4834-b688-5490c7c24c66 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153581 Jul 20 14:08:13.851909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1162/2118] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:14.328812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:14.329417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:14.336106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:14.336577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:14.337334 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:14.337762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:14.465759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:14.474281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9b3859a2-6fe6-4c5b-86c3-34653f29326c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149289 Jul 20 14:08:14.474849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 957/2119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:14 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:14.869468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:14.870070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:14.872537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:14.879127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:14.879573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:14.880371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:14.880799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:15.008656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:15.017071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:15.019254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:15.020424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-df086d3f-948d-4070-a0c1-b0ff280765af tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154904 Jul 20 14:08:15.020978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1163/2120] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:15.491757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:15.492395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:15.494773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:15.500392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:15.500832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:15.501588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:15.502087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:15.626596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:15.635379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b3343572-92ef-44a4-9738-89c5f8040a44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147447 Jul 20 14:08:15.636456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 958/2121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:15 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:16.039459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:16.040039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:16.046551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:16.046991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:16.047736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:16.048160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:16.177188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:16.185343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:16.186941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:16.188083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e8a3935e-5990-4f06-8985-e8cc8b725b78 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152524 Jul 20 14:08:16.188664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1164/2122] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:16 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:16.652089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:16.652734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:16.659909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:16.660397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:16.661203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:16.661644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:16.800698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:16.808572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-01dcdc6c-cc1c-40d0-85f9-64d891461482 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.160368 Jul 20 14:08:16.809132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 959/2123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:16 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:17.384632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:17.385247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:17.391222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:17.391673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:17.392584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:17.393629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:17.520711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:17.528982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:17.530462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:17.531589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-180dfd82-2261-4c12-91cf-32fd65dff11a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.329514 Jul 20 14:08:17.532138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1165/2124] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:17.825599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:17.826140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:17.833149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:17.833601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:17.834365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:17.834805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:17.963270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:17.971158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d6b819ad-b399-4f2c-9537-2656e97e7f08 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149572 Jul 20 14:08:17.971715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 960/2125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:17 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:18.549985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:18.550609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:18.557511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:18.557969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:18.558801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:18.559242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:18.699992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:18.709235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:18.711037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:18.712242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fe81fd3c-662f-4226-a99c-61c85a06d46a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.166398 Jul 20 14:08:18.712806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1166/2126] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:18.987419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:18.988034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:18.994774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:18.995216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:18.996007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:18.996457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:19.125528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:19.134371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-419aa24a-c5c3-43a8-8423-eca10b8e47b1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150849 Jul 20 14:08:19.134991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 961/2127] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:18 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:19.730148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:19.730748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:19.737154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:19.737592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:19.738341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:19.738768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:19.866017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:19.874502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:19.875988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:19.877806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d2548f3b-eb27-4de9-9435-b0ae7783c85e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150894 Jul 20 14:08:19.878373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1167/2128] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:20.151158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:20.151760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:20.158232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:20.158791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:20.159545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:20.160012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:20.287004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:20.295090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b67e14fe-fd4f-49dc-b2eb-a953252e962a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147715 Jul 20 14:08:20.295679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 962/2129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:20 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:20.896405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:20.897044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:20.903450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:20.903892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:20.904671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:20.905104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:21.030235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:21.038942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:21.040475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:21.041616 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e603647f-1f94-494f-a596-6e342720e20f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149642 Jul 20 14:08:21.042177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1168/2130] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:21.313007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:21.313620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:21.320100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:21.320583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:21.321357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:21.321794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:21.447581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:21.455975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6b0010c8-dd2e-4dd4-81b2-1ddf74bab813 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146404 Jul 20 14:08:21.456787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 963/2131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:21 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:22.059853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:22.060477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:22.066873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:22.067309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:22.068056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:22.068513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:22.197788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:22.206559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:22.208050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:22.209235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-89041dfe-e69b-43f5-8059-df6d1146aab3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153283 Jul 20 14:08:22.209784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1169/2132] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:22 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:22.473997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:22.474601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:22.481104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:22.481560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:22.482321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:22.482754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:22.616591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:22.624487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-efde6769-3130-4a5e-b41e-3e6f32cae44f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154836 Jul 20 14:08:22.625047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 964/2133] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:22 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:23.227554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:23.228146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:23.234609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:23.235050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:23.235801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:23.236249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:23.361206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:23.371792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:23.373455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:23.374694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ba315d55-6770-4d24-8e06-47d031151c3b tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151058 Jul 20 14:08:23.375280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1170/2134] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:23.641446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:23.642057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:23.649140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:23.649593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:23.650369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:23.650806 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:23.777515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:23.786022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-33fbebb2-31a9-4856-ba63-1549ab787658 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148409 Jul 20 14:08:23.786599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 965/2135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:23 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:24.392365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:24.392996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:24.399387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:24.399842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:24.400605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:24.401032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:24.529764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:24.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:24.539525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:24.540683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cd5b670f-b1cf-422a-979a-9f935408fbe0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152240 Jul 20 14:08:24.541232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1171/2136] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:24.803628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:24.804160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:24.810543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:24.810991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:24.811743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:24.812173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:24.937642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:24.946096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9ee423b6-47f1-46b1-a8ef-f433b538831b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146985 Jul 20 14:08:24.946661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 966/2137] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:24 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:25.559103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:25.559646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:25.566644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:25.567094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:25.567857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:25.568328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:25.699678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:25.708641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:25.710146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:25.711564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef089a04-0282-4a3b-9c17-79adddfdf8ba tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156523 Jul 20 14:08:25.712116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1172/2138] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:25.964093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:25.964725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:25.971222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:25.971666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:25.973089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:25.973514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:26.103959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:26.111905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-064f8ddf-f3ff-4b75-a670-1bcdfc2f1cc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151886 Jul 20 14:08:26.112504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 967/2139] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:25 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:26.729731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:26.730952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:26.737431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:26.738399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:26.739168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:26.739609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:26.869156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:26.877782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:26.879912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:26.881087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-03ec52d0-ca30-47c7-bf61-12b0fda0808e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155358 Jul 20 14:08:26.881656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1173/2140] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:27.128240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:27.128831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:27.135161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:27.135608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:27.136403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:27.136843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:27.265715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:27.274087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-47a01638-c057-44cb-98b5-d4cbb4108b57 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149792 Jul 20 14:08:27.274650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 968/2141] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:27 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:27.899136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:27.899743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:27.906312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:27.906758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:27.907513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:27.907947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:28.037714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:28.046104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:28.047609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:28.048787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-24e9a008-ecaf-432a-85d8-ca9443dc58b2 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153523 Jul 20 14:08:28.049347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1174/2142] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:28.291339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:28.291874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:28.297788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:28.298231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:28.298981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:28.299407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:28.430140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:28.438005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b16fa0cb-b7e0-43a7-b61b-b333e4e53131 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150719 Jul 20 14:08:28.438561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 969/2143] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:28 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:29.067648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:29.068281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:29.075077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:29.075526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:29.076308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:29.076745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:29.203523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:29.212105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:29.213623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:29.214862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5442bca2-5d93-47f4-bb6c-51d53c8b6121 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151702 Jul 20 14:08:29.215415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1175/2144] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:29 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:29.455328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:29.455939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:29.462712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:29.463161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:29.463924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:29.464399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:29.591535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:29.599980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4d1cc08a-272d-4bc6-a3df-9936dc2358ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148816 Jul 20 14:08:29.600567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 970/2145] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:29 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:30.233395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:30.234021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:30.241021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:30.241468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:30.242214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:30.242636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:30.382122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:30.390489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:30.391992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:30.393165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-258518bd-1b76-48ac-a500-9ee291171725 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.163747 Jul 20 14:08:30.393721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1176/2146] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:30.617234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:30.617904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:30.624529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:30.624984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:30.625758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:30.626197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:30.763968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:30.772512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c36b2a2e-6e81-4eae-840c-6ba1d37c045b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.159665 Jul 20 14:08:30.773070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 971/2147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:30 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:31.411828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:31.412462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:31.418931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:31.419374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:31.420135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:31.420603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:31.435698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:31.547080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:31.555415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:31.556988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:31.558153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2a5c8d29-e3d1-4aa3-b32f-1faaf056f63a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150796 Jul 20 14:08:31.558710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1177/2148] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:31.789593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:31.790140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:31.796727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:31.797176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:31.797943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:31.798377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:31.923068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:31.931481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d5d3c9e3-3e4b-40f5-8ef0-4c607788804b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145864 Jul 20 14:08:31.932050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 972/2149] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:31 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:32.575937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:32.576665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:32.583188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:32.583641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:32.584444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:32.584883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:32.725853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:32.734286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:32.735797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:32.736981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28060735-f48b-4757-bfcb-ce04d3ca3c77 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.164983 Jul 20 14:08:32.737545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1178/2150] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:32.951394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:32.951998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:32.959404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:32.959854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:32.960941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:32.961380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:32.965386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:33.093156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:33.101322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-593424a6-e14b-4bc9-b430-f6041ed03911 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153802 Jul 20 14:08:33.101880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 973/2151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:32 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:33.756031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:33.756703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:33.763349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:33.763797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:33.764589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:33.765025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:33.891852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:33.900231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:33.901743 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:33.902886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-66164e70-0702-400a-8bab-e4b3fdef085d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150831 Jul 20 14:08:33.903448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1179/2152] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:34.118095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:34.118700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:34.125163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:34.125603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:34.126356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:34.126784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:34.250621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:34.258494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-50059fbc-d836-426e-b423-62b8958877ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.144265 Jul 20 14:08:34.259062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 974/2153] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:34 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:34.921353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:34.921956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:34.928359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:34.928802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:34.929545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:34.929971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:35.058009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:35.066269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:35.068758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:35.069885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cbe869c2-8764-4575-8dc6-efe9f776c2e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152433 Jul 20 14:08:35.070434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1180/2154] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:35.274887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:35.275497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:35.282955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:35.283402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:35.284171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:35.284630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:35.411856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:35.420212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4cce237b-241b-455d-be4e-2a844675265d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149279 Jul 20 14:08:35.420768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 975/2155] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:35 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:36.088681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:36.089283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:36.095771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:36.096244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:36.097003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:36.097437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:36.226913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:36.235246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:36.236786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:36.237925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e84c1d2b-2ae2-4f05-8cff-c50cab04d0bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154074 Jul 20 14:08:36.238491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1181/2156] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:36 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:36.437694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:36.438294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:36.445353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:36.445794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:36.446546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:36.446971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:36.575363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:36.583407 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-40235638-1818-41a1-9c19-5ec305204311 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149605 Jul 20 14:08:36.583983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 976/2157] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:36 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:37.256017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:37.257270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:37.263601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:37.264039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:37.264817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:37.265244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:37.392399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:37.400750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:37.402270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:37.403395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-993cdbda-d70b-4f8b-8179-877b77515892 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151520 Jul 20 14:08:37.403948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1182/2158] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:37.601163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:37.601705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:37.608433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:37.608883 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:37.609651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:37.610085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:37.739767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:37.747701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ae6e8a4e-61b4-4ce2-bd14-54f06d2ce5ac tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151015 Jul 20 14:08:37.748326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 977/2159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:37 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:38.421937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:38.422522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:38.429606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:38.430046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:38.430791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:38.431216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:38.558948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:38.567198 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:38.569351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:38.570481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-12ed2d87-f562-48b8-a527-fcdc67f356b1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152451 Jul 20 14:08:38.571033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1183/2160] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:38.764686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:38.765538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:38.771964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:38.772448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:38.773218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:38.773659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:38.901961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:38.909773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e3cc0819-a29f-47eb-baca-1714d633609b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149045 Jul 20 14:08:38.910333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 978/2161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:38 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:39.589289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:39.589925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:39.596360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:39.596810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:39.597564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:39.597992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:39.723369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:39.731917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:39.733480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:39.734629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0e5a4b1c-31c9-45aa-9a18-5bbd93a46b39 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150160 Jul 20 14:08:39.735187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1184/2162] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:39.926757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:39.927363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:39.934225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:39.934667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:39.935424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:39.935852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:40.060213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:40.068016 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8b38d1f7-9610-495a-b66a-97e7815bc292 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145096 Jul 20 14:08:40.069299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 979/2163] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:39 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:40.751902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:40.752563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:40.759597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:40.760038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:40.760815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:40.761248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:40.888889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:40.897211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:40.898711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:40.899856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6d31e878-6f5c-4795-832e-81dbe7e09fce tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151782 Jul 20 14:08:40.900453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1185/2164] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:41.085845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:41.086445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:41.092939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:41.093326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:41.094076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:41.094504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:41.221320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:41.229941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1670735d-aa8f-46de-b7e9-5fee20b500b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148172 Jul 20 14:08:41.230513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 980/2165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:41 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:41.918204 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:41.918811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:41.925250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:41.925697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:41.926489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:41.926917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:42.054714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:42.063007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:42.064535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:42.065677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-926972cb-6bae-405b-8e86-f87b173da595 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151431 Jul 20 14:08:42.066231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1186/2166] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:42.246587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:42.247107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:42.253552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:42.254002 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:42.254771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:42.255207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:42.385000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:42.392878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2846ca7e-594d-4327-9501-296aaa674fd0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150223 Jul 20 14:08:42.393447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 981/2167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:42 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:43.085147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:43.085980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:43.092506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:43.092947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:43.093696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:43.094121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:43.221801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:43.230782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:43.232309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:43.233451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-daf61c20-f4dc-48af-9b3e-80b81bd9df6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153067 Jul 20 14:08:43.234039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1187/2168] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:43 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:43.409580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:43.410214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:43.416690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:43.417137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:43.417897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:43.418331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:43.543796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:43.551681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d2729a0c-250f-43bd-8104-57f8315e52ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145926 Jul 20 14:08:43.552257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 982/2169] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:43 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:44.251442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:44.252070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:44.258991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:44.259439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:44.260212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:44.260653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:44.391653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:44.400723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:44.402253 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:44.403389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a467ad19-85ff-4cce-9d90-ae98907a7ae6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155853 Jul 20 14:08:44.403949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1188/2170] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:44 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:44.568643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:44.569185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:44.575529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:44.575965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:44.576749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:44.577174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:44.705969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:44.714524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-96ed3371-f594-4ca8-bd47-ebef8a209f8b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149831 Jul 20 14:08:44.715079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 983/2171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:44 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:45.420946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:45.422859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:45.423836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:45.429840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:45.429840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:45.430105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:45.430382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:45.568409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:45.577472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:45.579034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:45.580176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8a5f8760-d602-4efa-a547-ee032080092f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.163149 Jul 20 14:08:45.580759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1189/2172] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:45 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:45.731816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:45.732395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:45.734607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:45.740052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:45.741076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:45.741950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:45.742379 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:45.864732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:08:45.864995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 (ip 10.222.0.17) !!! Jul 20 14:08:45.869870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:45.878917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8a9cd09a-a63b-4b67-8e89-4952bcef85fe tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151047 Jul 20 14:08:45.879482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 984/2173] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:45 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:46.598384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:46.598986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:46.605457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:46.605916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:46.606667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:46.607093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:46.738776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:46.747548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:46.749095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:46.750226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e8576423-2c4a-426a-ab45-10d3d230c3b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155762 Jul 20 14:08:46.750775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1190/2174] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:46 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:46.895143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:46.895779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:46.902437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:46.902917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:46.903684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:46.904139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:47.033701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:47.041568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0793fb8c-31a9-4d99-bab0-e2b59504c975 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150234 Jul 20 14:08:47.042117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 985/2175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:46 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:47.769005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:47.769611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:47.776249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:47.776707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:47.777458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:47.777891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:47.904178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:47.912535 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:47.914029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:47.915168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-80c71720-4207-4adc-974f-2acb4ee45d00 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150046 Jul 20 14:08:47.915716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1191/2176] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:47 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:48.058332 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:48.058944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:48.065403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:48.065858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:48.066628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:48.067070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:48.194116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:48.201923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b37e5143-78e5-45d0-be6e-3cfdb857d6f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147431 Jul 20 14:08:48.202480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 986/2177] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:48 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:48.933827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:48.934543 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:48.941113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:48.941557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:48.942316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:48.942751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:49.070003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:49.079361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:49.080908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:49.082058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8726dc60-7086-4716-806f-81d8746c5713 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152197 Jul 20 14:08:49.082620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1192/2178] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:48 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:49.219281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:49.219799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:49.226157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:49.226604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:49.227354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:49.227784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:49.353957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:49.361716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-95fe7a17-09b1-4b05-bc06-37c741dc20f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146352 Jul 20 14:08:49.362276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 987/2179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:49 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:50.100750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:50.101363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:50.108153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:50.108964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:50.110380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:50.111147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:50.378976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:50.379588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:50.386073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:50.386513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:50.387279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:50.387701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:50.394527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:50.407908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:50.409447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:50.410605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8ab2c56c-01f7-43a6-8bc8-40901efda4ca tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.314259 Jul 20 14:08:50.411362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1193/2180] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:50 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:50.524522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:50.532481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-93a0c845-cc75-445d-a60e-9c9db04c0db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.157468 Jul 20 14:08:50.533050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 988/2181] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:50 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:08:51.433655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:51.434235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:51.440688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:51.441133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:51.441888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:51.442320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:51.445477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:51.550894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:51.551603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:51.558812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:51.559258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:51.560025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:51.560484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:51.570097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:51.578563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:51.580053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:51.581208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17096e8f-4006-43d8-9186-f2760f768939 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151483 Jul 20 14:08:51.581754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1194/2182] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:51 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:51.688637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:51.690785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:51.697716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c5748603-d1da-4821-ac77-c63c8e6be431 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150747 Jul 20 14:08:51.698282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 989/2183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:51 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:08:52.598963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:52.599571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:52.606138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:52.606586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:52.607347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:52.607793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:52.714578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:52.715316 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:52.722088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:52.722645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:52.723415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:52.723909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:52.738746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:52.747585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:52.749101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:52.750252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-005f49da-fe55-479a-89c6-f713940d40fb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155233 Jul 20 14:08:52.750805 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1195/2184] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:52 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:52.853293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:52.861149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6535d4e3-3246-4a9d-8aeb-9a8f614cc50d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150831 Jul 20 14:08:52.861709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 990/2185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:52 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:53.768986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:53.769590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:53.773022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:08:53.774668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:08:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 (ip 10.222.0.17) !!! Jul 20 14:08:53.776801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:53.777562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:53.778580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:53.779416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:53.878541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:53.879198 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:53.885905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:53.886381 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:53.887157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:53.887595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:53.909511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:53.918374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:53.919867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:53.921035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6366ff09-9c4b-412c-8bb2-8a3dd14f72fd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156006 Jul 20 14:08:53.921787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1196/2186] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:53 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:54.013258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:54.021144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ffd4b0c7-eaf1-406d-8466-b83b8f1c9d0b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146601 Jul 20 14:08:54.021705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 991/2187] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:53 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:08:54.292931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:08:54.293126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:08:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:08:54.938904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:54.939575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:54.946615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:54.947055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:54.947811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:54.948268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:55.038376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:55.038994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:55.045743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:55.046190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:55.046957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:55.047390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:55.074201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:55.082699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:55.084216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:55.085372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-693e184d-32e4-41a7-8edf-f8d40a816dda tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150391 Jul 20 14:08:55.086242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1197/2188] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:54 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:55.173646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:55.181860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2f50cbd7-27f0-4c72-b658-16e87c89210d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147328 Jul 20 14:08:55.182421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 992/2189] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:55 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:08:55.997792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:08:55.997986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:08:56.104094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:56.104732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:56.111334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:56.111783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:56.112569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:56.113006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:56.201271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:56.201961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:56.208432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:56.208878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:56.209637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:56.210064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:56.245058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:56.253471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:56.254883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:56.256026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1d41176a-e955-4b5f-843b-922c65323c6c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156317 Jul 20 14:08:56.256640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1198/2190] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:56 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:56.339538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:56.347474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3f2d91dc-b12d-4514-b3f4-f9f9473433fc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150205 Jul 20 14:08:56.348025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 993/2191] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:56 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:08:57.273077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:57.274179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:57.280550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:57.280986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:57.281727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:57.282149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:57.364833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:57.365448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:57.372124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:57.372608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:57.373378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:57.373814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:57.412962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:57.422624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:57.424042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:57.425211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9c44e353-b800-4f4c-bf06-bb3d3336f023 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155992 Jul 20 14:08:57.425754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1199/2192] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:57 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:57.502955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:57.511200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6645cd47-0472-4c39-9ddf-7ccd0037c4aa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150187 Jul 20 14:08:57.511751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 994/2193] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:57 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:08:58.443596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:58.444244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:58.451171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:58.451611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:58.452398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:58.452832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:58.528963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:58.529524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:58.535458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:58.535907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:58.536706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:58.537145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:58.584804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:58.594326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:58.595871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:58.597073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c43fc205-41ad-4148-b5dc-d73661843278 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157363 Jul 20 14:08:58.597618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1200/2194] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:58 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:58.667800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:58.675733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7338a5af-5165-425c-b2e0-d51fffd6f25a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150912 Jul 20 14:08:58.676309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 995/2195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:58 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:08:59.614946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:59.615555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:59.622113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:59.622555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:59.623423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:59.623876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:59.693505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:08:59.694164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:08:59.700982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:59.701481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:59.702208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:08:59.702644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:08:59.751117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:59.759960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:59.761558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:59.762703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-23d179da-ec8e-49a7-9619-6bc86b76f073 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151699 Jul 20 14:08:59.763254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1201/2196] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:08:59 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:08:59.829949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:08:59.839426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-35ba3aa3-6b0e-46a2-8d7e-5e3506e73560 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149831 Jul 20 14:08:59.839994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 996/2197] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:08:59 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:00.781027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:00.781656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:00.788053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:00.788538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:00.789297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:00.789734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:00.857256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:00.857797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:00.864052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:00.864539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:00.865291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:00.866001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:00.920894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:00.930123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:00.932702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:00.933854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f4544e6a-bafc-43a7-8ef0-d685b8181d5a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156804 Jul 20 14:09:00.940138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1202/2198] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:00 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:00.998131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:01.005934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a00de1da-0239-4a2c-b2e6-5765a223026d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153212 Jul 20 14:09:01.006490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 997/2199] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:00 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:01.952583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:01.953192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:01.959506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:01.959942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:01.960979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:01.961401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:02.022886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:02.023530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:02.029937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:02.030392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:02.031170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:02.031607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:02.089711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:02.097997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:02.099498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:02.100674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d9e028ae-a6d8-4468-944f-bfd6355a7c25 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152004 Jul 20 14:09:02.101224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1203/2200] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:01 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:02.157481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:02.165309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-86a387cb-e72a-4dca-a9a8-b87910e7b4b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146343 Jul 20 14:09:02.165863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 998/2201] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:02 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:03.118926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:03.119529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:03.126083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:03.126533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:03.127290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:03.127729 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:03.182140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:03.182854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:03.189787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:03.190302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:03.191078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:03.191538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:03.255375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:03.264461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:03.265967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:03.267115 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ef28358c-dffb-444b-97a5-3eec1826365c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152097 Jul 20 14:09:03.268128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1204/2202] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:03 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:03.318086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:03.326495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-591ef021-bd09-424c-93cb-2df9ab1c6006 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148308 Jul 20 14:09:03.327057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 999/2203] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:03 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:04.285821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:04.286429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:04.293460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:04.293910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:04.294674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:04.295112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:04.343202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:04.343844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:04.350287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:04.350737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:04.351516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:04.351953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:04.428402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:04.436924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:04.438429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:04.439582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2557efbc-c227-443a-aa5e-d915ade37261 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157710 Jul 20 14:09:04.440139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1205/2204] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:04 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:04.482301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:04.490176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0cef1e59-091b-4960-9d93-7188268eec5d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150794 Jul 20 14:09:04.490742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1000/2205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:04 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:05.457890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:05.458439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:05.465189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:05.465637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:05.466392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:05.466828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:05.506893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:05.507511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:05.514019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:05.514471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:05.515239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:05.515674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:05.595918 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:05.606095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:05.608456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:05.609945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-25a4337b-1af2-4da6-8b37-a056540b5547 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156120 Jul 20 14:09:05.610500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1206/2206] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:05 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:05.646574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:05.654591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a5c7422f-3a27-451e-afc1-d39fdeb437a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151579 Jul 20 14:09:05.655146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1001/2207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:05 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:06.630812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:06.631420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:06.638803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:06.639285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:06.640059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:06.640528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:06.670691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:06.671439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:06.677819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:06.678259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:06.679013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:06.679437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:06.770816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:06.779324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:06.780865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:06.782025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4b40b83d-6fda-4e13-b5c1-1fb356bbd3bc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155134 Jul 20 14:09:06.782585 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1207/2208] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:06 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:07.047978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:07.055800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8b0be189-6ee9-4180-b914-6dee00ca6a03 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.388921 Jul 20 14:09:07.056389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1002/2209] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:06 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:07.800278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:07.800891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:07.807391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:07.807840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:07.808624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:07.809065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:07.933404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:07.941623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:07.943102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:07.944258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e32334f1-1247-4d96-abf5-43df9e1aee08 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.147996 Jul 20 14:09:07.944802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1208/2210] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:07 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:08.073771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:08.074371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:08.080892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:08.081340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:08.082099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:08.082533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:08.207248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:08.215283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dde9ebca-5a29-4943-a186-86ce7086d6ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146127 Jul 20 14:09:08.215839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1003/2211] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:08 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:08.964154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:08.964783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:08.971182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:08.971629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:08.972419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:08.972853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:09.098088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:09.106896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:09.108416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:09.109559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40b6a278-c3be-4744-bd45-c46614b598b8 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150064 Jul 20 14:09:09.110114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1209/2212] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:08 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:09.231389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:09.231929 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:09.239049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:09.239543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:09.240359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:09.240799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:09.369378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:09.377141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4c5ebbb6-3937-4d79-880d-15b65da651b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149761 Jul 20 14:09:09.377701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1004/2213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:09 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:10.127361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:10.127971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:10.134558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:10.135021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:10.135779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:10.136233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:10.265037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:10.267259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:10.274985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:10.277207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:10.278356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-44f5b374-80f2-4ccd-930e-8878953bf6cc tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154899 Jul 20 14:09:10.278909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1210/2214] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:10 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:10.394917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:10.395555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:10.402827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:10.403363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:10.404231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:10.404742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:10.534945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:10.543627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e888a304-6ef1-459e-8fa7-1a4521d34908 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152574 Jul 20 14:09:10.544561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1005/2215] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:10 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:11.297258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:11.297863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:11.304311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:11.304758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:11.305513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:11.305943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:11.432991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:11.441355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:11.442844 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:11.443974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ba6d3ed4-df0a-46ba-8591-faf5d6ad95a1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150632 Jul 20 14:09:11.444557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1211/2216] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:11 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:11.561807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:11.562344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:11.568710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:11.569153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:11.569905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:11.570335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:11.585869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:11.698214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:11.706101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7e4b697a-9a20-4eb1-85fc-9deb984baca4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148193 Jul 20 14:09:11.706665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1006/2217] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:11 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:12.463428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:12.464051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:12.470460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:12.470899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:12.471647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:12.472071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:12.606424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:12.615125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:12.616653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:12.617794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-db9baf4b-cf8c-4f24-a7e2-6ea697d8400a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.159078 Jul 20 14:09:12.618337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1212/2218] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:12 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:12.723808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:12.724384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:12.731556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:12.732004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:12.732799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:12.733237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:12.862174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:12.869936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ebc4f217-92c0-499f-9c6e-977ffc789495 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150033 Jul 20 14:09:12.870501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1007/2219] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:12 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:13.636439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:13.637028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:13.643452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:13.643916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:13.644719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:13.645155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:13.770119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:13.779017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:13.780550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:13.781698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7b910ea9-45e0-4b6e-adc9-74f2968fb9d0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149810 Jul 20 14:09:13.782258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1213/2220] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:13 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:13.887282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:13.887798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:13.894176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:13.894618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:13.895369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:13.895797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:14.029789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:14.037631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f6de9720-423a-4d37-9b11-086d0ff3a61d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154770 Jul 20 14:09:14.038189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1008/2221] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:13 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:14.705967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:09:14.706182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:09:14.799663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:14.800298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:14.807391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:14.807835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:14.808626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:14.809060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:14.936726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:14.945057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:14.946575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:14.948340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0f903345-826b-41bd-ad6c-194e585a6b69 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152570 Jul 20 14:09:14.948901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1214/2222] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:14 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:15.054505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:15.055105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:15.062081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:15.062520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:15.063272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:15.063700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:15.192522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:15.200833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-38fc0f98-bbb3-4537-9c7c-6b857096de9a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150193 Jul 20 14:09:15.201383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1009/2223] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:15 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:15.967286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:15.967893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:15.970188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:15.975410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:15.975856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:15.976640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:15.977073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:16.157993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:16.166182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:16.167657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:16.168812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-10165116-ce57-4ed8-a223-d56ad2af0597 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.206045 Jul 20 14:09:16.169353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1215/2224] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:15 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:16.218342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:16.218873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:16.221157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:16.226306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:16.226731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:16.227481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:16.227908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:16.404859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:16.412776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-05371600-04e2-4bb1-a061-af494d8476a1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.198302 Jul 20 14:09:16.413336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1010/2225] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:16 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:17.186872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:17.187471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:17.193540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:17.193980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:17.194732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:17.195154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:17.319259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:17.327884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:17.329403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:17.330525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f1b0a9df-202a-457d-9faa-e95b9355aa1d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.147572 Jul 20 14:09:17.331071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1216/2226] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:17 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:17.429737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:17.430997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:17.437613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:17.437998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:17.438757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:17.439186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:17.563914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:17.571717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3ef4e15e-a781-404e-9ae8-a4452f6cd8a7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145896 Jul 20 14:09:17.572787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1011/2227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:17 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:18.349515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:18.350153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:18.356790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:18.357238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:18.357991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:18.358424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:18.488149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:18.498237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:18.499884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:18.501194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b1d8a282-dde7-4fb3-b936-489c56865dfd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.155578 Jul 20 14:09:18.501885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1217/2228] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:18 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:18.588689 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:18.589295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:18.595979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:18.596455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:18.597218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:18.597651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:18.727675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:18.735539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-42f48761-8080-49e9-8939-a81b62d26f6c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151012 Jul 20 14:09:18.736094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1012/2229] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:18 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:19.520463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:19.521081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:19.527996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:19.528464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:19.529218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:19.529647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:19.655211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:19.663494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:19.665025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:19.666169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4610edfe-b89f-442d-95d9-6c1c4a173772 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149744 Jul 20 14:09:19.666718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1218/2230] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:19 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:19.752848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:19.753500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:19.760382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:19.760821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:19.761573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:19.761999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:19.887055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:19.894836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f8c2efaa-01d6-4f10-86f2-24cf3ac2db1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145833 Jul 20 14:09:19.895392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1013/2231] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:19 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:20.684757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:20.685360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:20.691796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:20.692259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:20.693007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:20.693434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:20.826770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:20.835301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:20.837067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:20.838731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-472afd4e-a35f-414f-9f36-6bc362297476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.158610 Jul 20 14:09:20.839278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1219/2232] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:20 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:20.912563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:20.913193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:20.920221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:20.920682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:20.921464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:20.921917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:21.053090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:21.061054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ed16efd9-c0dc-4eef-916f-d22ef168e2ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152320 Jul 20 14:09:21.061618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1014/2233] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:20 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:21.857368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:21.857951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:21.864343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:21.864787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:21.865529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:21.865954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:21.991881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:22.000178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:22.001690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:22.002824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4be3f2cc-5505-4253-9ef0-02dcf3256b71 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.149971 Jul 20 14:09:22.003376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1220/2234] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:21 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:22.077938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:22.078541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:22.084965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:22.085418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:22.086426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:22.086857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:22.214068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:22.222042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2a58cb62-db6c-4bcc-8ec4-69f70b6f7871 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147908 Jul 20 14:09:22.222603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1015/2235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:22 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:23.021285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:23.021896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:23.028512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:23.028964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:23.029733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:23.030170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:23.159471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:23.167904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:23.169449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:23.170598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-33124306-ce5c-458d-89e0-9c5f11d9cfab tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153227 Jul 20 14:09:23.171161 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1221/2236] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:23 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:09:23.238726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:23.239408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:23.246375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:23.246824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:23.247590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:23.248026 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:23.378764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:23.386755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-832d537c-c598-4f18-990d-d7db13996a63 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151850 Jul 20 14:09:23.387322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1016/2237] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:23 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:24.189010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:24.189646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:24.196324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:24.196786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:24.198050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:24.198510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:24.326984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:24.335167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:24.336948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:24.338650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-82faf555-f8d0-46ee-8173-bb04765641ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153844 Jul 20 14:09:24.339196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1222/2238] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:24 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:24.404679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:24.405292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:24.411737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:24.412203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:24.412984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:24.413424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:24.539640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:24.547583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dc6b2737-d4b9-4769-b5f5-40396d2176cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147568 Jul 20 14:09:24.548145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1017/2239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:24 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:25.357314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:25.357923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:25.365584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:25.366035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:25.366799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:25.367234 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:25.493797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:25.502147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:25.503650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:25.504818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cba42f72-115c-4eaf-a904-dbcd7df131d9 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152155 Jul 20 14:09:25.505371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1223/2240] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:25 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:25.564961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:25.565573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:25.572036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:25.572510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:25.573278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:25.573715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:25.701674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:25.709628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5a82e2d1-d432-47f7-b94f-f0b6e46e8274 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148502 Jul 20 14:09:25.710187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1018/2241] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:25 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:26.523413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:26.524023 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:26.531163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:26.531617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:26.532408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:26.532845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:26.662802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:26.671127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:26.672659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:26.673808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7680a0e4-5102-4a21-a637-b8ead7c49476 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.154377 Jul 20 14:09:26.674368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1224/2242] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:26 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:26.732366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:26.732997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:26.739315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:26.739762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:26.740543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:26.740973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:26.870575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:26.878420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-30978461-99cc-4406-8170-6e1957a53400 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150013 Jul 20 14:09:26.878984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1019/2243] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:26 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:27.690830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:27.691433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:27.697931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:27.698372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:27.699132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:27.699562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:27.828966 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:27.838109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:27.839601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:27.840782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a22e9c7d-eba9-4ba7-ba3a-1b4915ebe553 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153836 Jul 20 14:09:27.841341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1225/2244] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:27 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:27.896020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:27.896683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:27.903304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:27.903748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:27.904545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:27.904970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:28.109147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:28.117241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-60a25a13-be79-40fe-b776-38a82d1244b2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.225181 Jul 20 14:09:28.118030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1020/2245] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:27 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:28.858593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:28.859133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:28.865459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:28.865903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:28.866647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:28.867068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:28.994179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:29.002437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:29.003935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:29.005101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-def93100-287c-4a0b-835b-34c9b56814bd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150512 Jul 20 14:09:29.005658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1226/2246] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:28 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:29.135182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:29.135723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:29.142514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:29.142962 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:29.143730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:29.144165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:29.274036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:29.283071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eae42c83-ef0d-4db0-b7cf-80c02a2ba24b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152359 Jul 20 14:09:29.283630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1021/2247] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:29 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:30.022896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:30.023481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:30.030863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:30.031300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:30.032050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:30.032579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:30.047692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:30.159981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:30.168327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:30.169825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:30.170961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bac1d004-22c1-4c00-9c1e-5a47d35b95e5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151996 Jul 20 14:09:30.171515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1227/2248] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:30 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:30.299930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:30.300479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:30.306893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:30.307343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:30.308110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:30.308573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:30.433768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:30.441743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f1a661f0-7983-4bd6-a691-78ba7cbd7a18 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145712 Jul 20 14:09:30.442306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1022/2249] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:30 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:31.189419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:31.190030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:31.197101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:31.197699 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:31.198579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:31.199227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:31.325456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:31.333734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:31.335244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:31.336674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b964befb-eec7-43c8-b421-b5341438a02d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151193 Jul 20 14:09:31.337229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1228/2250] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:31 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:31.458753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:31.459330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:31.466339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:31.466785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:31.467549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:31.467982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:31.470502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:31.598037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:31.606671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff565066-9142-4592-8c4f-1dd23bbe6ff6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151742 Jul 20 14:09:31.607245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1023/2251] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:31 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:32.355214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:32.355821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:32.362522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:32.363001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:32.363760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:32.364211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:32.499690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:32.508093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:32.509614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:32.510754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4b989f18-683a-474a-96a7-03682e782a1a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.160034 Jul 20 14:09:32.511308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1229/2252] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:32 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:32.623863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:32.624491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:32.631039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:32.631484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:32.632307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:32.632741 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:32.758577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:32.766356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5324a424-7896-4465-925d-d1fb7e01516e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146975 Jul 20 14:09:32.766915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1024/2253] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:32 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:33.529690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:33.530302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:33.536415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:33.536869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:33.537658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:33.538092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:33.665712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:33.674652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:33.676145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:33.677334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a478ab94-b96d-487b-858a-742b6e4854e6 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.152624 Jul 20 14:09:33.677890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1230/2254] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:33 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:33.782863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:33.783415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:33.789777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:33.790217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:33.790967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:33.791400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:33.921231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:33.928996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-87874389-025d-4974-9fed-28f679814db1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149981 Jul 20 14:09:33.929554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1025/2255] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:33 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:34.695369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:34.695976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:34.702930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:34.703378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:34.704158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:34.704601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:34.832797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:34.841862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:34.843418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:34.844595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bc7572d4-ef94-42f5-8ad3-c61b1ed06bbd tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.153098 Jul 20 14:09:34.845151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1231/2256] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:34 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:34.946041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:34.946634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:34.953665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:34.954107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:34.954867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:34.955301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:35.079784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:35.087885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fdddb0d7-f181-43a7-b87e-f6313be58bca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145804 Jul 20 14:09:35.088519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1026/2257] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:34 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:35.862601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:35.863199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:35.870123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:35.870569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:35.871327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:35.871762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:35.998590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:36.006927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:36.008455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:36.009596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cf020153-116d-46fc-b588-b4074fb78652 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.150940 Jul 20 14:09:36.010199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1232/2258] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:35 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:36.105380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:36.106010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:36.112427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:36.112867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:36.113620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:36.114052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:36.245988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:36.253904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dc9ecc29-5f16-4757-bb27-c5ba0751ab10 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152874 Jul 20 14:09:36.254477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1027/2259] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:36 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:37.029731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:37.030418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:37.036816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:37.037262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:37.038015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:37.038445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:37.171771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:37.180079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:37.181603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:37.183228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3f633cdf-e8a7-4938-938c-448800868bc3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157563 Jul 20 14:09:37.183775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1233/2260] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:37 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:37.270617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:37.271230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:37.278148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:37.278596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:37.279358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:37.279844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:37.408290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:37.416049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-136ad4d8-5272-4bf5-bc37-042b5d5d16d9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149262 Jul 20 14:09:37.416634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1028/2261] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:37 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:38.202958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:38.203553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:38.209990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:38.210433 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:38.211436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:38.211861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:38.344573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:38.352873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:38.354342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:38.355471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5ed44592-b98a-423b-bd88-23ac6f3abe0a tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.157790 Jul 20 14:09:38.356018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1234/2262] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:38 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:38.433564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:38.434202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:38.440791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:38.441239 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:38.442027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:38.442458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:38.572841 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:38.581169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e20abf4d-d38d-4c1d-8bab-5e68ecb6f0cb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151600 Jul 20 14:09:38.581726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1029/2263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:38 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:39.373419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:39.374019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:39.380444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:39.380890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:39.381636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:39.382061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:39.509547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:39.518658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:39.520231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:39.521406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1b12fa1e-18cb-445c-997e-54d5852a283e tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.151872 Jul 20 14:09:39.521970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1235/2264] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:39 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:39.599017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:39.599629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:39.606424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:39.606873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:39.607640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:39.608079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:39.738043 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:39.745843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7fb34590-b506-4ddd-ae88-7c9deafef385 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150908 Jul 20 14:09:39.746920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1030/2265] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:39 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:40.539672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:40.540295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:40.547268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:40.547708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:40.548491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:40.548964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:40.681597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:40.689878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:40.691367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:40.692528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bfd866c5-5e7c-49bc-a7f4-142147c8c4eb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.156748 Jul 20 14:09:40.693091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1236/2266] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:40.763199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:40.763801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:40.770187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:40.770639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:40.771392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:40.771824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:40.897533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:40.906059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-48472442-db6f-4ed5-87c0-4e8c807f76bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147196 Jul 20 14:09:40.906621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1031/2267] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:40 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:41.711133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:41.711738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:41.718759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.719208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:41.719969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.720437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:41.799455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:41.799991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:41.806414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.807154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:41.807687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.808441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:41.834148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Going to try to terminate instance {{(pid=129542) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:09:41.861012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:41.869523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:41.871132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:41.872384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-37ed50e0-4bd6-456e-b03f-65a995720250 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1801 microversion: 2.20 time: 0.165226 Jul 20 14:09:41.872941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1237/2268] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:41 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:41.891107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-35a56a14-0eab-4559-80b2-803ffe508903 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '.version_select at 0x7fa40d182310>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:41.914466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-35a56a14-0eab-4559-80b2-803ffe508903 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814395199" status: 204 len: 0 microversion: 2.20 time: 0.027060 Jul 20 14:09:41.915354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1238/2269] 10.222.0.17 () {60 vars in 1258 bytes} [Wed Jul 20 14:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814395199 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 14:09:41.924147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:41.925014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:41.932417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.932930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:41.933845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.935165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:41.937491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3fc83487-366e-4d2c-aa63-9439b4e8001e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 204 len: 0 microversion: 2.1 time: 0.141504 Jul 20 14:09:41.938283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1032/2270] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:09:41 2022] DELETE /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 14:09:41.946857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:41.947556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:41.953710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.954322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:41.955104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:41.955544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:42.071088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:42.079883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9d85904b-3482-4e61-8ff7-3b85bbf74f85 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.159966 Jul 20 14:09:42.080497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1239/2271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:41 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:42.197862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:42.206572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3f2666b6-4322-4c0b-b607-fc4029a9c72a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1720 microversion: 2.1 time: 0.263992 Jul 20 14:09:42.207141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1033/2272] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:43.097376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:43.098643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:43.108649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:43.108649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:43.108649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:43.108649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:43.267155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-85ca0911-9fc9-4504-9e74-4ec62acd1512 req-61795bce-2e34-4692-aeb0-c6000f0029cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:09:43.276482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-85ca0911-9fc9-4504-9e74-4ec62acd1512 req-61795bce-2e34-4692-aeb0-c6000f0029cc service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:43.277228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-85ca0911-9fc9-4504-9e74-4ec62acd1512 req-61795bce-2e34-4692-aeb0-c6000f0029cc service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:43.288997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-85ca0911-9fc9-4504-9e74-4ec62acd1512 req-61795bce-2e34-4692-aeb0-c6000f0029cc service nova] Creating event network-changed:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 14:09:43.295984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-85ca0911-9fc9-4504-9e74-4ec62acd1512 req-61795bce-2e34-4692-aeb0-c6000f0029cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182230 Jul 20 14:09:43.297365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1034/2273] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:09:43.316429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:43.319343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:43.333128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:43.333323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:43.333966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:43.334946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:43.336262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:43.344792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8bf9040f-a2d7-488c-b3d4-a7d263ad7554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.251429 Jul 20 14:09:43.346809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1240/2274] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:43 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:43.354005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-24475101-2598-47b6-939b-712b75c81c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'create', calling method: .version_select at 0x7fa40d170a60>, body: {"keypair": {"name": "tempest-keypair-846180536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI77FLqDbviOnV7ifqLt8x0jGsC2NwSVJlLrXWNQRZMc2m0aUENeFSPhPMXc2NcgFSwQWsxpBfsMOqtkDfXVXIR2fjjqWjpcDf4CMCmnFmtEwOa5vXPx9cZ9rP6IvsAO3g=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:09:43.377393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-24475101-2598-47b6-939b-712b75c81c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for project cc6c042204f0471ba5c2f8a67604a802. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:09:43.383379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-24475101-2598-47b6-939b-712b75c81c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for user f9cb52fe271348c1bc0ffda92063bf59 and project cc6c042204f0471ba5c2f8a67604a802. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:09:43.411959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-24475101-2598-47b6-939b-712b75c81c89 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.063719 Jul 20 14:09:43.424863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1241/2275] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jul 20 14:09:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 14:09:43.796589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:43.807237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ea76b4eb-1513-44b4-b05a-63c4f5e8beb2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1720 microversion: 2.1 time: 0.508379 Jul 20 14:09:43.809928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1035/2276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1720 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:44.371647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:44.373179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:44.380123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:44.385476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:44.387122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:44.389734 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:44.611125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:44.625138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6336f9a3-f085-4136-acd3-5f6847b6e48f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.257614 Jul 20 14:09:44.640175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1242/2277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:44 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:44.826373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:44.828171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:44.836219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:44.836989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:44.837979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:44.838625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:44.921312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:44.929171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8ba2b979-7831-4259-8ac6-9b67158dbc73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.106747 Jul 20 14:09:44.940287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1036/2278] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:45.343316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-45cd12b1-7aca-48ae-b3fc-62ce28ff103e req-b1b3d287-cb61-407d-b2ad-a50f7ec6dfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa1a351-f890-4b69-9606-4fa868d1443d", "name": "network-vif-deleted", "tag": "a7cc4326-225c-4a06-a40d-e0e89993ff52"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:09:45.353434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-45cd12b1-7aca-48ae-b3fc-62ce28ff103e req-b1b3d287-cb61-407d-b2ad-a50f7ec6dfc0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:45.358683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-45cd12b1-7aca-48ae-b3fc-62ce28ff103e req-b1b3d287-cb61-407d-b2ad-a50f7ec6dfc0 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:45.383418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-45cd12b1-7aca-48ae-b3fc-62ce28ff103e req-b1b3d287-cb61-407d-b2ad-a50f7ec6dfc0 service nova] Creating event network-vif-deleted:a7cc4326-225c-4a06-a40d-e0e89993ff52 for instance 1aa1a351-f890-4b69-9606-4fa868d1443d on hv-cinder-81914 Jul 20 14:09:45.391388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-45cd12b1-7aca-48ae-b3fc-62ce28ff103e req-b1b3d287-cb61-407d-b2ad-a50f7ec6dfc0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053436 Jul 20 14:09:45.393478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1243/2279] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:09:45.519469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-696109476", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f19ce632-ef4e-4ff0-a5d7-ee203095cf35"}], "security_groups": [{"name": "tempest-securitygroup--820941051"}], "key_name": "tempest-keypair-846180536", "user_data": "}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:09:45.630040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] validate_networks() for [('f19ce632-ef4e-4ff0-a5d7-ee203095cf35', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:09:45.643548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:45.644308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:45.655687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:45.656211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:45.657127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:45.657575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:45.801992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:45.811028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-86f0a61d-b084-4791-a961-d12c4ca54576 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.171689 Jul 20 14:09:45.812146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1244/2280] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:45 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:45.946901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:45.947658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:45.954228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:45.954679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:45.955803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:45.956617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:46.018679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:46.026882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6ab60624-5554-45f4-b756-379f8f0c5dda tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083865 Jul 20 14:09:46.028237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1245/2281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:46.081134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:09:46.081624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:09:46.082009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:09:46.082415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:09:46.082819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:09:46.093048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:46.093495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:46.094297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:46.094728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:46.110862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for project cc6c042204f0471ba5c2f8a67604a802. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:09:46.114742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Getting quotas for user f9cb52fe271348c1bc0ffda92063bf59 and project cc6c042204f0471ba5c2f8a67604a802. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:09:46.125421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:09:46.127630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:09:46.174368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e1147f14-c393-425d-9e0f-b191eebf8e42 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.659113 Jul 20 14:09:46.184659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1037/2282] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jul 20 14:09:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 14:09:46.194509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7c455a5c-6556-4a5c-82b0-19972d221815 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:46.195163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7c455a5c-6556-4a5c-82b0-19972d221815 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:46.197280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:46.251732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7c455a5c-6556-4a5c-82b0-19972d221815 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:46.259063 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7c455a5c-6556-4a5c-82b0-19972d221815 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:46.260664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7c455a5c-6556-4a5c-82b0-19972d221815 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:46.262378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7c455a5c-6556-4a5c-82b0-19972d221815 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1280 microversion: 2.20 time: 0.071105 Jul 20 14:09:46.262934 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1246/2283] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:46 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:09:46.828403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:46.829027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:46.831042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:46.837769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:46.838216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:46.839011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:46.839475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:46.974333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:46.982982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0ce1df19-4c2c-4032-b3af-1e82cb9457a4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.158653 Jul 20 14:09:46.983547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1038/2284] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:46 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:47.044608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:47.045211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:47.052371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:47.052816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:47.053561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:47.053991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:47.114421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:47.117359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:47.124178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-421047ae-4739-4e99-ae2b-19a7c0708067 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084072 Jul 20 14:09:47.124765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1247/2285] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:47.284812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:47.285786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:47.292255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:47.293361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:47.294172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:47.294644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:47.312554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:47.374397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:47.382353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:47.383874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:47.385080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-295cbe4d-afbe-4211-97c2-d063b26b3737 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1350 microversion: 2.20 time: 0.108853 Jul 20 14:09:47.385638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1039/2286] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:47 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:48.000798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:48.001419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:48.008091 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:48.008571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:48.009469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:48.009906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:48.141855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:48.142749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:48.148991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:48.149435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:48.150247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:48.150676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:48.219887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:48.227506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2aac2d15-1f02-4504-b0cc-99508b627b5c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086340 Jul 20 14:09:48.227506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1040/2287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:48.239749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:48.250609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-488f216c-143b-4553-9625-ab68a6f5797b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.253575 Jul 20 14:09:48.251203 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1248/2288] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:47 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:48.403277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:48.403875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:48.409964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:48.410403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:48.411159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:48.411593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:48.559629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:48.573372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:48.576588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:48.578350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-62ce3835-0f10-4deb-8f2a-c2449a5bf335 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1405 microversion: 2.20 time: 0.179377 Jul 20 14:09:48.582666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1041/2289] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:48 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:48.771484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-1b5acd74-865d-48d7-a808-f5fb374388b6 req-b2b8451a-617d-4547-8428-ca6efb751faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d333753-3f98-4c38-b879-a134f8f7de72", "tag": "dbe58ce8-e811-47ee-923a-01b2c71c23e6"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:09:48.780282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-1b5acd74-865d-48d7-a808-f5fb374388b6 req-b2b8451a-617d-4547-8428-ca6efb751faa service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:48.780731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-1b5acd74-865d-48d7-a808-f5fb374388b6 req-b2b8451a-617d-4547-8428-ca6efb751faa service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:48.795209 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-1b5acd74-865d-48d7-a808-f5fb374388b6 req-b2b8451a-617d-4547-8428-ca6efb751faa service nova] Creating event network-changed:dbe58ce8-e811-47ee-923a-01b2c71c23e6 for instance 8d333753-3f98-4c38-b879-a134f8f7de72 on hv-cinder-81914 Jul 20 14:09:48.800461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-1b5acd74-865d-48d7-a808-f5fb374388b6 req-b2b8451a-617d-4547-8428-ca6efb751faa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097128 Jul 20 14:09:48.801374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1249/2290] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:09:49.240202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:49.240834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:49.247251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:49.247700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:49.248493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:49.248927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:49.267839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:49.268554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:49.274680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:49.275130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:49.275882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:49.276344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:49.311237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:49.319421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9641c47c-3d9a-486d-bbe4-034b2400bb38 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083133 Jul 20 14:09:49.319994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1042/2291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:49.410355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:49.419122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4d18be0b-e3a6-4ae3-a1a3-d08df217ee2f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.155951 Jul 20 14:09:49.419695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1250/2292] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:49 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:49.596910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:49.597519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:49.603532 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:49.603983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:49.604773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:49.605705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:49.737451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:49.745358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:49.747507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:49.748630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1af704bb-c2ae-47cd-bff9-9d977e7daee1 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1405 microversion: 2.20 time: 0.155650 Jul 20 14:09:49.749181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1043/2293] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:49 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:50.338604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:50.339210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:50.345653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:50.346095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:50.346853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:50.347284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:50.424142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:50.434106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c2bcd128-0bc4-49ff-8d28-a080db8f39a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.098977 Jul 20 14:09:50.440328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1251/2294] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:50.443584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:50.444583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:50.452005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:50.452549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:50.453378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:50.453869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:50.586413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:50.594661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cf50cf60-4735-4d53-9078-54295903b9ef tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.162350 Jul 20 14:09:50.595325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1044/2295] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:50 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:09:50.765849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:50.766622 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:50.772668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:50.773118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:50.773990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:50.774429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:50.907283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:50.915244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:50.916766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:50.918511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-84d8b365-4b2f-4a82-a4b7-3644330a7cfb tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1405 microversion: 2.20 time: 0.155927 Jul 20 14:09:50.919067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1252/2296] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:50 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:51.451732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:51.452358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:51.458812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:51.459268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:51.460117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:51.460497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:51.524106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:51.532022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a28ff0ee-0c3a-47a8-bd16-90b2a4dc3267 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084883 Jul 20 14:09:51.532613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1045/2297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:51.611127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:51.611753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:51.618086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:51.618529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:51.619277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:51.619707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:51.747735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:51.755573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-015275b3-95ad-48c0-98e1-aea7be3a9748 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148267 Jul 20 14:09:51.756144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1253/2298] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:51 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:51.936409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:51.937017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:51.943030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:51.943480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:51.944265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:51.944705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:52.077051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:52.084805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:52.086567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:52.087659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0ba1c401-c6ff-424a-baf6-a355553de0ad tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1405 microversion: 2.20 time: 0.155251 Jul 20 14:09:52.088237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1046/2299] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:51 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:52.549196 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:52.549836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:52.556106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:52.556599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:52.557377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:52.557815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:52.654594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-8dce0dac-b2cb-457d-aaac-bec64b6180fc req-976ef467-74bd-4619-b6a6-dbc8370be435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d333753-3f98-4c38-b879-a134f8f7de72", "name": "network-vif-plugged", "status": "completed", "tag": "dbe58ce8-e811-47ee-923a-01b2c71c23e6"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:09:52.656224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:52.663787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-8dce0dac-b2cb-457d-aaac-bec64b6180fc req-976ef467-74bd-4619-b6a6-dbc8370be435 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:52.664263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-8dce0dac-b2cb-457d-aaac-bec64b6180fc req-976ef467-74bd-4619-b6a6-dbc8370be435 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:52.664983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8fc7fd6a-bbb0-48da-8f1b-f489e6b9f56a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.119608 Jul 20 14:09:52.665681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1254/2300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:52.675753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-8dce0dac-b2cb-457d-aaac-bec64b6180fc req-976ef467-74bd-4619-b6a6-dbc8370be435 service nova] Creating event network-vif-plugged:dbe58ce8-e811-47ee-923a-01b2c71c23e6 for instance 8d333753-3f98-4c38-b879-a134f8f7de72 on hv-cinder-81914 Jul 20 14:09:52.681003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-8dce0dac-b2cb-457d-aaac-bec64b6180fc req-976ef467-74bd-4619-b6a6-dbc8370be435 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109822 Jul 20 14:09:52.681579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1047/2301] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:09:52.773963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:52.774917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:52.781427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:52.781887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:52.782631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:52.783059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:52.970111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:52.978147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae2c039a-9f43-4058-8d56-3515f315321f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.208420 Jul 20 14:09:52.978716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1255/2302] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:52 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:53.105466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:53.106146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:53.112240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:53.112687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:53.113432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:53.113861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:53.240758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:53.249093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:53.250595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:53.251680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b8936bb7-6e2c-455c-84dd-9bed4711104f tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1405 microversion: 2.20 time: 0.150485 Jul 20 14:09:53.252248 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1048/2303] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:53 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:53.681238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:53.681883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:53.688385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:53.688837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:53.689595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:53.690026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:53.751184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:53.759814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9e78ab47-b201-478c-b91a-ff60cae920a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082474 Jul 20 14:09:53.760399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1256/2304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:53.994860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:53.995460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:54.002163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:54.002609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:54.003376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:54.003815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:54.132731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:54.141052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fe0ed016-b135-4454-976a-23f5adefa0f8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150066 Jul 20 14:09:54.141620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1049/2305] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:53 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:54.269824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:54.270347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:54.276279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:54.276747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:54.279561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:54.279988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:54.417898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:54.425739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:54.427247 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:54.428380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7398e20d-0a82-480d-8162-8e5b7b8e701d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1405 microversion: 2.20 time: 0.162512 Jul 20 14:09:54.428941 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1257/2306] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:54 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:54.776584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:54.777223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:54.783245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:54.783702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:54.784486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:54.784927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:54.844714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:54.852513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-12499b70-979f-4377-be48-e11522b8f8c3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079819 Jul 20 14:09:54.853079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1050/2307] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:55.158471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:55.159050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:55.165409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.165851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.166596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.167019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.291794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:55.299579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-12c2b43b-b471-4f82-8e7f-5b89e822aff2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.144928 Jul 20 14:09:55.300133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1258/2308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:55 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:55.446697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:55.447232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:55.454277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.454715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.455470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.455902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.581858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:55.589987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:55.591472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:55.592640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fcc3cd73-7e79-4f0d-a8a0-1ccd8383db51 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1597 microversion: 2.20 time: 0.149954 Jul 20 14:09:55.593192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1051/2309] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:09:55 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1597 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:09:55.612213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9bd52a01-6811-40e4-9caf-11f0a9c0c24d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:55.612714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9bd52a01-6811-40e4-9caf-11f0a9c0c24d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:55.618661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bd52a01-6811-40e4-9caf-11f0a9c0c24d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.619109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bd52a01-6811-40e4-9caf-11f0a9c0c24d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.619873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bd52a01-6811-40e4-9caf-11f0a9c0c24d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.620338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9bd52a01-6811-40e4-9caf-11f0a9c0c24d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.695451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9bd52a01-6811-40e4-9caf-11f0a9c0c24d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087098 Jul 20 14:09:55.696041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1259/2310] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jul 20 14:09:55 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 14:09:55.869619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:55.870233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:55.876869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.877321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.878080 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:55.878516 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:55.943090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:55.951046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-830f34be-b218-46d2-8c1a-652532e112dc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085242 Jul 20 14:09:55.951663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1052/2311] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:56.313815 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=6 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:56.318056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:56.318670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:56.325476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:56.325926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:56.326757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:56.327202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:56.527314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:56.535340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a5ffc19b-1f47-4893-98bf-0e1dbb2a6464 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.222934 Jul 20 14:09:56.535948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1260/2312] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:56 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:56.667131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-7fb48284-194a-4288-86d3-d4eb7bcf78f1 req-5c004e89-ff5c-4556-96c7-b055bdeae32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d333753-3f98-4c38-b879-a134f8f7de72", "tag": "dbe58ce8-e811-47ee-923a-01b2c71c23e6"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:09:56.670837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:56.671537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:56.678891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-7fb48284-194a-4288-86d3-d4eb7bcf78f1 req-5c004e89-ff5c-4556-96c7-b055bdeae32c service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:56.679339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-7fb48284-194a-4288-86d3-d4eb7bcf78f1 req-5c004e89-ff5c-4556-96c7-b055bdeae32c service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:56.691002 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-7fb48284-194a-4288-86d3-d4eb7bcf78f1 req-5c004e89-ff5c-4556-96c7-b055bdeae32c service nova] Creating event network-changed:dbe58ce8-e811-47ee-923a-01b2c71c23e6 for instance 8d333753-3f98-4c38-b879-a134f8f7de72 on hv-cinder-81914 Jul 20 14:09:56.696211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-7fb48284-194a-4288-86d3-d4eb7bcf78f1 req-5c004e89-ff5c-4556-96c7-b055bdeae32c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032623 Jul 20 14:09:56.697015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1053/2313] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:09:56.969189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:56.970043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:56.977831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:56.978274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:56.979050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:56.979479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:57.178713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:57.187847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e2de3250-0e8d-49a9-b83b-03dd8060fdd2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.223675 Jul 20 14:09:57.188555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1261/2314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:57.552916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:57.553612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:57.559816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:57.560315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:57.561084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:57.561522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:57.700415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:57.708446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-969b22fc-733f-4104-a1e9-e7424ffd8a0d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.159864 Jul 20 14:09:57.709020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1054/2315] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:57 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:58.204297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:58.204908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:58.211663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:58.212199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:58.212974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:58.213411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:58.273394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:58.285678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9374dfab-8f69-46f2-b79f-1750f15d11cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085309 Jul 20 14:09:58.286264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1262/2316] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:58.726258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:58.726865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:58.733649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:58.734091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:58.734846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:58.735280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:58.860948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:58.868668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c5c0bc9c-1e9a-4ecb-8495-71096c46c8cc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146271 Jul 20 14:09:58.869222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1055/2317] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:58 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:59.302287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:59.302955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:59.309548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:59.309998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:59.310754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:59.311193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:59.372949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:09:59.380816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dff5d315-3a85-4379-b2a3-114f10e2b280 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082369 Jul 20 14:09:59.381384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1263/2318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:09:59.886287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:09:59.887466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:09:59.894069 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:59.894518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:09:59.895276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:09:59.895713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:00.027690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:00.035518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c1393490-2c60-40d1-91c7-3ba93349f0a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153303 Jul 20 14:10:00.036077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1056/2319] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:09:59 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:00.398146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:00.398752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:00.406077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:00.406521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:00.407275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:00.407710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:00.473384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:00.481927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-265e098b-12f6-4073-bf2a-f2329eb8fd54 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087612 Jul 20 14:10:00.482481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1264/2320] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:01.052600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:01.053211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:01.059621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:01.060063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:01.060854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:01.061286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:01.076850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:01.189522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:01.198471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ea3069c1-0f92-43e7-b17b-a285d789d05c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149350 Jul 20 14:10:01.199637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1057/2321] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:01 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:01.499373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:01.499983 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:01.506468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:01.506913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:01.507700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:01.508136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:01.524295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:01.570076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:01.578021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aee286d2-673b-4d36-9b9d-60ad734cc0b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083088 Jul 20 14:10:01.578580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1265/2322] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:02.217111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:02.217723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:02.224231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:02.224679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:02.225433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:02.225865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:02.355802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:02.370312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8984077e-9656-46df-b7b2-dba7e689c9f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.157563 Jul 20 14:10:02.370915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1058/2323] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:02 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:02.595680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:02.596222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:02.602737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:02.603276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:02.604037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:02.604502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:02.665482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:02.673675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-736ed89a-b172-44e3-bf2e-497d809e89f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081959 Jul 20 14:10:02.674240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1266/2324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:03.387393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:03.388030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:03.394558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:03.395012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:03.395782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:03.396247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:03.523402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:03.531762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bba73306-8c60-427c-816a-2d5b56bc6669 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148273 Jul 20 14:10:03.532345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1059/2325] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:03 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:03.690625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:03.691231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:03.697694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:03.698138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:03.698894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:03.699323 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:03.760008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:03.768495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c6817598-5a20-4ad3-b3b5-da606ea64235 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081743 Jul 20 14:10:03.769061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1267/2326] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:04.549337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:04.549943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:04.556421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:04.556865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:04.557620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:04.558686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:04.688318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:04.696112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a463cf9e-a6c5-473d-b39e-320cd658caf9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150615 Jul 20 14:10:04.696711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1060/2327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:04 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:04.785732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:04.786366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:04.793309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:04.793746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:04.794491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:04.794916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:04.864131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:04.872919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6eb76000-473d-41d5-9898-f8d919d9eee0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.091171 Jul 20 14:10:04.873480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1268/2328] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:04 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:05.713083 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:05.713686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:05.720178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:05.720651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:05.721393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:05.721817 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:05.850258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:05.858149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-58771608-7b45-48ee-b071-0f543a88d23c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149147 Jul 20 14:10:05.858709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1061/2329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:05 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:05.890229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:05.890779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:05.897208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:05.897685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:05.898445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:05.898885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:05.959764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:05.967978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-53dc8ba8-643e-4065-b3b3-d18aff339f33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082354 Jul 20 14:10:05.968568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1269/2330] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:06.874935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:06.875567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:06.882227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:06.882607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:06.883362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:06.883792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:06.984300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:06.985000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:06.991445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:06.991967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:06.992830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:06.993261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:07.012326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:07.021318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-500aec81-390e-400a-8177-f581058c4ac3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150054 Jul 20 14:10:07.035698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1062/2331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:06 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:07.058470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:07.066793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2c528446-d98c-48b2-861c-e1915b7b3325 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086429 Jul 20 14:10:07.067427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1270/2332] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:08.045543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:08.046300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:08.052694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:08.053137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:08.053891 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:08.054321 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:08.085011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:08.086049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:08.093054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:08.093506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:08.094284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:08.094721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:08.158933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:08.167190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-07abcf73-e6fd-4118-9518-c51330f58ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086066 Jul 20 14:10:08.167859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1271/2333] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:08.188384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:08.196218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-20745870-8923-4c06-b87e-4b70e663eca6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.156752 Jul 20 14:10:08.196771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1063/2334] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:08 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:09.185153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:09.185754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:09.192051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:09.192516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:09.193287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:09.193711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:09.213475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:09.214135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:09.221041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:09.221498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:09.222369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:09.222844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:09.257656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:09.266580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-55d694aa-b3cd-426d-a47d-9f60efdbfbd1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085806 Jul 20 14:10:09.267154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1272/2335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:09.353187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:09.361672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d73023d7-1b9c-447d-a909-a2cb8966e101 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152494 Jul 20 14:10:09.362243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1064/2336] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:09 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:10.282976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:10.283519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:10.290084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:10.290528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:10.291274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:10.291707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:10.351607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:10.359368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b8a0eb2d-de21-4066-a447-a554554b89d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080386 Jul 20 14:10:10.359920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1273/2337] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:10.378445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:10.379050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:10.385599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:10.386044 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:10.387366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:10.387796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:10.517202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:10.525642 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a53b875a-4427-4284-b625-2c5dd57c018b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151029 Jul 20 14:10:10.526213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1065/2338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:10 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:11.376207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:11.376834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:11.383239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:11.383687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:11.384576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:11.385018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:11.445942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:11.454254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-edf4dd95-11c9-4021-90e3-9bd6b016f7cb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082084 Jul 20 14:10:11.454816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1274/2339] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:11.541638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:11.542238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:11.549143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:11.549585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:11.550327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:11.550753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:11.678841 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:11.686805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-014a7a3d-0317-4d60-9b7e-1519e090a324 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149011 Jul 20 14:10:11.687393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1066/2340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:11 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:12.471843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:12.472490 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:12.479028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:12.479465 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:12.480238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:12.481299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:12.541308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:12.550153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b10e75bd-ed59-485e-9967-b20862641816 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082119 Jul 20 14:10:12.550748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1275/2341] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:12.703789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:12.704427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:12.711075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:12.711521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:12.712286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:12.712720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:12.840685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:12.848562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-247dc632-b9ff-4101-9bd3-0d84f294da8e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148476 Jul 20 14:10:12.849120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1067/2342] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:12 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:13.567279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:13.567883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:13.574290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:13.574726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:13.575473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:13.575900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:13.638940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:13.646784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-afcd03bc-3db8-48c1-909e-2c6554d8672d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083367 Jul 20 14:10:13.647352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1276/2343] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:13.865489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:13.866026 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:13.872482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:13.873416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:13.874164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:13.874590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:14.006786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:14.015358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a1bed39b-91d2-4302-a3e5-50fab9944c1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153758 Jul 20 14:10:14.015922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1068/2344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:13 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:14.662778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:14.663386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:14.670504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:14.670951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:14.672065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:14.672511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:14.734469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:14.742325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-94f1d019-7541-43ea-879c-8991a1fcc125 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083425 Jul 20 14:10:14.742887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1277/2345] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:15.032971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:15.033579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:15.040245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:15.040697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:15.041495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:15.041932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:15.168262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:15.176160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9de682a2-ea8a-4ab6-94fd-196c799626a8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147615 Jul 20 14:10:15.176795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1069/2346] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:15 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:15.759026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:15.759671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:15.767179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:15.767624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:15.768402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:15.768840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:15.828522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:15.836562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6f3e9ec8-b748-4b28-9602-f8910df84a8d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081444 Jul 20 14:10:15.837120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1278/2347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:16.193285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:16.193932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:16.200465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:16.200909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:16.201666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:16.202715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:16.330943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:16.339060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ec6df0b5-a8ce-4bda-b695-06947c6f4972 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149612 Jul 20 14:10:16.339621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1070/2348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:16 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:16.854012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:16.854759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:16.857045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=68 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:16.863402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:16.863845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:16.864634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:16.865068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:16.924977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:16.932600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-43e8707c-ee3e-4db0-bc0d-b52c47450e7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082504 Jul 20 14:10:16.933163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1279/2349] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:17.356393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:17.356934 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:17.359317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=66 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:17.364553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:17.364998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:17.365739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:17.366162 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:17.493114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:17.500974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bcca843b-d4f2-4fae-a633-0b026250189a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148635 Jul 20 14:10:17.501535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1071/2350] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:17 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:17.949405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:17.950034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:17.956005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:17.956562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:17.957328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:17.957766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:18.021169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:18.028999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-72bcff90-10be-4d5a-87c5-98448ee950f4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083709 Jul 20 14:10:18.029563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1280/2351] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:18.518611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:18.519218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:18.525462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:18.525906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:18.526663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:18.527086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:18.660610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:18.668528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b6c96296-b414-4095-af17-2632b918d366 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154110 Jul 20 14:10:18.669097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1072/2352] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:18 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:19.045703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:19.046308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:19.052711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:19.053157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:19.053910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:19.054342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:19.115147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:19.123211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-04085e43-7b74-4702-94cb-bc06529fde57 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081376 Jul 20 14:10:19.123771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1281/2353] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:19.802397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:19.803001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:19.808948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:19.809389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:19.810137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:19.810560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:19.936548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:19.945228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d260b68d-9d0b-44f9-9ee6-62430fc87a83 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.262849 Jul 20 14:10:19.946097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1073/2354] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:19 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:20.140600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:20.141174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:20.148275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:20.148802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:20.149564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:20.149998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:20.152512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:20.211182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:20.218940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a6163013-0548-4c22-8c8b-cbb7e4e73532 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082418 Jul 20 14:10:20.219509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1282/2355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:20 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:20.963330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:20.963944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:20.970430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:20.970873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:20.971625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:20.972055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:20.974578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:21.100413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:21.108211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-380a86dc-fe6c-4daa-87df-2f85166f8433 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149040 Jul 20 14:10:21.108780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1074/2356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:20 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:21.236653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:21.237167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:21.243432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:21.243869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:21.244653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:21.245080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:21.305821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:21.313625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-36c01e30-7d74-4d7d-9afa-1ae94535a8c5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081409 Jul 20 14:10:21.314178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1283/2357] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:22.124780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:22.125422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:22.132452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:22.132906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:22.133712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:22.134147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:22.263919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:22.272368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-14743905-79da-4f62-9b1e-6ebef1041cce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151381 Jul 20 14:10:22.272936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1075/2358] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:22 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:22.330838 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:22.331447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:22.338125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:22.338571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:22.339327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:22.339761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:22.404241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:22.412051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6b513322-6bb6-4480-8fa7-b5fb59afd52a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085659 Jul 20 14:10:22.412649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1284/2359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:23.289350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:23.289951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:23.296496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:23.296945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:23.297698 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:23.298130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:23.422598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:23.429168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:23.429823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:23.430978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-29d405b4-b1c4-4ae7-9bff-fd3d37f52b71 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145452 Jul 20 14:10:23.431546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1076/2360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:23 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:23.436364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:23.438469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:23.438469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:23.438469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:23.498344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:23.506228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ee88c299-e897-474c-a6ef-aee672ded853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080827 Jul 20 14:10:23.506790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1285/2361] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:24.447686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:24.448305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:24.454784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:24.455909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:24.456745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:24.457180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:24.523364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:24.524043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:24.530453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:24.530910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:24.531677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:24.532125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:24.590333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:24.594251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:24.598993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dc2caf1c-41b6-42ab-8956-68a520e35d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.155226 Jul 20 14:10:24.599617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1077/2362] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:24 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:24.602403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0419ae27-b472-4061-a1c2-1555d3d37e55 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083014 Jul 20 14:10:24.602964 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1286/2363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:24 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:25.616573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:25.617180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:25.618656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:25.619269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:25.623524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:25.623972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:25.624758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:25.625188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:25.625688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:25.626140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:25.626903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:25.627341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:25.687879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:25.695873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-afd9b4f8-b0fc-4621-9e72-a2d3b7828a5d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080923 Jul 20 14:10:25.696471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1287/2364] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:25.756942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:25.764777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-102d2672-6bfe-4ca4-97f3-6951f71c98e5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152240 Jul 20 14:10:25.765340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1078/2365] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:25 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:26.712865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:26.713469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:26.719979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:26.720459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:26.721304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:26.721737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:26.782211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:26.782801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:26.787476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:26.789310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:26.789759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:26.790601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:26.791035 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:26.795809 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1789d8c0-7504-4c51-8b52-940d115446db tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087069 Jul 20 14:10:26.796407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1288/2366] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:26.916652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:26.924986 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-38b6d1ef-360d-4456-8e03-df22f092bd97 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146657 Jul 20 14:10:26.925551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1079/2367] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:26 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:27.812506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:27.813116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:27.819625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:27.820070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:27.820864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:27.821301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:27.885124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:27.893550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9715f058-8b55-4ff1-aff8-fcfe01e270dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084975 Jul 20 14:10:27.894100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1289/2368] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:27.941719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:27.942331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:27.948571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:27.949022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:27.949783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:27.950217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:28.082865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:28.090908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ac7ea7e5-757f-49d6-969e-8cbdd51399ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153048 Jul 20 14:10:28.091461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1080/2369] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:27 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:28.910340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:28.910968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:28.917418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:28.917858 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:28.918615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:28.919041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:28.984595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:28.992324 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-58c3eaf8-3173-4980-9fc5-24d62235054c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085834 Jul 20 14:10:28.992892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1290/2370] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:29.106675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:29.107283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:29.114210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:29.114662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:29.115430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:29.115867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:29.255172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:29.263033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5aec1c0f-5f90-440e-9908-05e4b5df049b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.160114 Jul 20 14:10:29.263595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1081/2371] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:29 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:30.008510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:30.009162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:30.015486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:30.015928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:30.016705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:30.017132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:30.078730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:30.087475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8b8724a9-13ca-4bc4-8169-20c879a36d88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082823 Jul 20 14:10:30.088034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1291/2372] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:30.279125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:30.279680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:30.286092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:30.286533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:30.287294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:30.287730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:30.415906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:30.423712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9383b6d8-0df4-467a-9774-1e188682b5b9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148458 Jul 20 14:10:30.424298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1082/2373] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:30 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:31.104793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:31.105395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:31.112421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:31.112869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:31.113620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:31.114051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:31.177096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:31.184823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-df33f7e4-6fa6-4ecc-9be3-b6d72e1db0e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083902 Jul 20 14:10:31.185392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1292/2374] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:31.440175 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:31.440796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:31.447192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:31.447628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:31.448419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:31.448847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:31.575518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:31.583731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b271dde4-e1c7-49d3-827e-931db7e60c35 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147380 Jul 20 14:10:31.584303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1083/2375] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:31 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:32.201691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:32.202305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:32.208824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:32.209275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:32.210040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:32.210478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:32.271476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:32.279348 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d4fc2a04-6949-427f-8d5d-7b9c51822868 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081498 Jul 20 14:10:32.279909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1293/2376] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:32.601924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:32.602483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:32.608988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:32.609437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:32.610188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:32.610618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:32.739541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:32.747524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0199f1df-16c8-4846-9b28-1f2c2c976c45 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149605 Jul 20 14:10:32.748086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1084/2377] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:32 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:32.924028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9946f5a1-1447-4a46-a9ee-56fd3cb831c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:32.924575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9946f5a1-1447-4a46-a9ee-56fd3cb831c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:32.930610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9946f5a1-1447-4a46-a9ee-56fd3cb831c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:32.931057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9946f5a1-1447-4a46-a9ee-56fd3cb831c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:32.931825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9946f5a1-1447-4a46-a9ee-56fd3cb831c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:32.932287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9946f5a1-1447-4a46-a9ee-56fd3cb831c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:32.954397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9946f5a1-1447-4a46-a9ee-56fd3cb831c7 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72/ips" status: 200 len: 152 microversion: 2.20 time: 0.034374 Jul 20 14:10:32.955462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1294/2378] 10.222.0.17 () {60 vars in 1288 bytes} [Wed Jul 20 14:10:32 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 14:10:33.296348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:33.296868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:33.302918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:33.303364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:33.304120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:33.304679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:33.364154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:33.372020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3a3bc43c-51af-4316-b9fe-ac2503793be0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079661 Jul 20 14:10:33.372615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1085/2379] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:33.764399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:33.765008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:33.771385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:33.771827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:33.772607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:33.773040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:33.897660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:33.905545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3c868f69-6b84-4348-8163-3aff845e3b70 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145012 Jul 20 14:10:33.906104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1295/2380] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:33 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:34.389496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:34.390065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:34.396982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:34.397417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:34.398177 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:34.398605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:34.458382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:34.466465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-35d0f34e-0858-4dd5-9c09-8ba95b19da6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080928 Jul 20 14:10:34.467029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1086/2381] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:34.922589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:34.923125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:34.929638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:34.930145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:34.930908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:34.931343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:35.060047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:35.068414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-991f950c-b79f-4fe6-81e1-33131a93f39a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149770 Jul 20 14:10:35.068979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1296/2382] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:34 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:35.482697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:35.483305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:35.490385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:35.490832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:35.491588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:35.492024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:35.554812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:35.562589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e7652ab0-bcab-44e5-9592-142eced3c04a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083708 Jul 20 14:10:35.563150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1087/2383] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:36.085448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:36.086423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:36.092927 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:36.093376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:36.094137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:36.094570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:36.220027 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:36.228404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0e132b09-ac32-4a6c-b4e3-6f031913e68d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146819 Jul 20 14:10:36.228962 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1297/2384] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:36 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:36.579041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:36.579637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:36.586522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:36.586971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:36.587730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:36.588165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:36.652031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:36.660903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fbab8fb6-3e5f-4026-8bd1-c29b234ac2e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085828 Jul 20 14:10:36.661465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1088/2385] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:37.245940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:37.246552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:37.253534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:37.253979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:37.254740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:37.255176 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:37.382649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:37.390501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2e5b514e-47ec-423b-9c6b-ac5da861e248 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148432 Jul 20 14:10:37.391074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1298/2386] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:37 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:37.678192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:37.678798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:37.685269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:37.685712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:37.686468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:37.686899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:37.748563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:37.756415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7ce1b315-18e5-4f33-8662-fc9cb625a09b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082541 Jul 20 14:10:37.756973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1089/2387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:38.407363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:38.408010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:38.415050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:38.415496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:38.416277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:38.416713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:38.420625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:38.550083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:38.557939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-174cbb43-a437-457e-8bed-e6e3faf2d8ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154464 Jul 20 14:10:38.558497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1299/2388] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:38 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:38.773653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:38.774189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:38.780776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:38.781221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:38.781973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:38.782401 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:38.842412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:38.844615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:38.851405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-147ed075-5550-4b29-870f-c7dc738ff4e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081635 Jul 20 14:10:38.851963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1090/2389] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:38 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:39.575318 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:39.575898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:39.582947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:39.583388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:39.584128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:39.584575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:39.713238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:39.721071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-57b4888a-5f79-49d6-9a50-168a49d66a72 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149599 Jul 20 14:10:39.721631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1300/2390] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:39 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:39.868020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:39.868577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:39.875120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:39.875567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:39.876354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:39.877398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:39.937389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:39.947488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b69be658-18c4-4a79-a3dc-90222f16f9de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082556 Jul 20 14:10:39.948145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1091/2391] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:40.738177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:40.738807 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:40.745292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:40.745732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:40.746478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:40.746904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:40.877545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:40.885387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9ebf46ea-8fce-45fb-805f-68bfaf22228f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151052 Jul 20 14:10:40.885885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1301/2392] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:40 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:40.966443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:40.967055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:40.973626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:40.974074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:40.974862 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:40.975295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:41.042623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:41.050471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9160e930-2574-446d-8ef5-fc57c4cfa524 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087913 Jul 20 14:10:41.051022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1092/2393] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:41.902813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:41.903428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:41.909866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:41.910314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:41.911065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:41.911498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:42.041790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:42.050222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-27201197-e144-466b-93ca-a546a8c6ff68 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151281 Jul 20 14:10:42.050792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1302/2394] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:41 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:42.067235 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:42.067869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:42.074230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:42.074676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:42.075432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:42.075864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:42.137975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:42.145699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-764382e0-cb1b-49a6-ad69-66fcd0dca0c7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082898 Jul 20 14:10:42.146259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1093/2395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:43.067483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:43.068095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:43.074590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:43.075050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:43.076129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:43.076593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:43.161958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:43.162566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:43.169089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:43.169534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:43.170290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:43.170723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:43.206239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:43.215357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ada5d88c-219f-4029-9539-01d43a84b163 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151732 Jul 20 14:10:43.216222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1303/2396] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:43 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:43.233982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:43.242610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-65a97af8-fcfc-489c-a5d0-9ff45bfe8685 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084906 Jul 20 14:10:43.243163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1094/2397] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:44.233278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:44.233888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:44.240852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:44.241300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:44.242060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:44.242492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:44.259357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:44.259967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:44.266389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:44.266840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:44.267604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:44.268039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:44.329059 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:44.338014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-67cc8e37-f13e-43f7-9ea8-0a75e91f9403 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082430 Jul 20 14:10:44.338699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1095/2398] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:10:44.375917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:44.384471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-30c42d9e-04fa-438e-ac83-593d0b99dda2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154931 Jul 20 14:10:44.385025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1304/2399] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:44 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:45.354793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:45.355399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:45.361890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:45.362336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:45.363099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:45.363530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:45.404728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:45.405342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:45.411881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:45.412366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:45.413134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:45.413564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:45.427699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:45.436873 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d2513f91-c0cc-46e4-9c86-bb41dee7b093 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085901 Jul 20 14:10:45.437636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1096/2400] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:45.541318 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:45.549301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-50f2f966-bea6-40d1-9752-f002f00b65f9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151191 Jul 20 14:10:45.549872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1305/2401] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:45 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:46.457375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:46.458018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:46.464711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:46.465157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:46.465912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:46.466348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:46.526997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:46.535579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a915a7af-6aa1-4f57-ac87-12faf7354995 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085248 Jul 20 14:10:46.536141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1097/2402] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:46.566728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:46.567336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:46.573808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:46.574257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:46.575016 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:46.575449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:46.705602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:46.714469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a43661bb-5b8b-4c10-aa4e-36fb6b4775ad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151484 Jul 20 14:10:46.715061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1306/2403] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:46 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:47.552562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:47.553168 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:47.555494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=54 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:47.560851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:47.561300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:47.562060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:47.562497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:47.623499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:47.631440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2d510efc-a523-450a-ba95-0ef8c1c09ac5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083471 Jul 20 14:10:47.632007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1098/2404] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:47.730982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:47.731602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:47.733434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=56 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:47.739294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:47.739733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:47.740509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:47.740937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:47.864832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:47.872637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40256111-3198-4a2a-99aa-19265660a554 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145627 Jul 20 14:10:47.873201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1307/2405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:47 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:48.647667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:48.648693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:48.655003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:48.655446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:48.656213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:48.656649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:48.726972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:48.735036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e2294aa6-69c1-4134-b042-abc3c065253f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.091702 Jul 20 14:10:48.735602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1099/2406] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:48.889929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:48.890460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:48.897338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:48.897782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:48.898538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:48.898970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:49.027244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:49.035069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1ef7eb6e-dbb0-46a1-9a56-c5334c4c2cc7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149188 Jul 20 14:10:49.035636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1308/2407] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:48 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:49.751601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:49.752264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:49.758802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:49.759242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:49.760051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:49.760449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:49.826993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:49.834793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5f42899f-4f47-4a44-bc82-1732e1bbdb21 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087003 Jul 20 14:10:49.835353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1100/2408] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:50.052835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:50.053444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:50.059949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:50.060435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:50.061229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:50.061666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:50.187690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:50.195466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3a7950ec-aeea-436b-91dd-395188109604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147229 Jul 20 14:10:50.196028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1309/2409] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:50 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:50.850836 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:50.851441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:50.857915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:50.858360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:50.859109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:50.859538 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:50.920658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:50.929001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bed4ff44-0962-4fa1-ba43-f2dd8b9cd69b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082000 Jul 20 14:10:50.929559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1101/2410] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:51.213683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:51.214229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:51.220603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:51.221052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:51.221806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:51.222268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:51.345445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:51.353314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-438d8942-add3-425d-84b3-2028978d6780 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.143852 Jul 20 14:10:51.353878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1310/2411] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:51 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:51.945780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:51.946377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:51.952847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:51.953289 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:51.954030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:51.954456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:52.014241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:52.022034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9d8384b1-f1c5-431a-b794-558c85569315 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080123 Jul 20 14:10:52.022592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1102/2412] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:52.370429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:52.370965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:52.377356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:52.377806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:52.378554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:52.378987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:52.519872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:52.527842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-11b4ae22-2eee-4d32-840c-fc0a10affe22 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.161390 Jul 20 14:10:52.528443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1311/2413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:52 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:53.039061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:53.039670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:53.046144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:53.046586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:53.047339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:53.047771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:53.109104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:53.116957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f979f7e6-f6c6-425e-bc78-f200a0a973ff tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081802 Jul 20 14:10:53.117561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1103/2414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:53.545620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:53.546289 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:53.553500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:53.553949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:53.554710 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:53.555147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:53.681662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:53.689445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9b451f96-abff-4fa0-8697-1436507631ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147699 Jul 20 14:10:53.690004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1312/2415] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:53 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:54.133798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:54.134402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:54.141046 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:54.141498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:54.142254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:54.142688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:54.206092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:54.214739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-36e52fd4-c0fc-4249-aeff-10c381ddf3b2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085032 Jul 20 14:10:54.215298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1104/2416] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:54.706065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:54.706669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:54.713461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:54.713909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:54.714664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:54.715095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:54.843077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:54.850951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-97ccd78b-b525-4871-8549-f7340b61a65d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148721 Jul 20 14:10:54.851516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1313/2417] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:54 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:55.231644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:55.232278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:55.238778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:55.239229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:55.239988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:55.240460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:55.301044 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:55.308708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-342b4760-2201-454b-a1ca-f4a62aaab2a2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081193 Jul 20 14:10:55.309292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1105/2418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:55.867896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:55.868522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:55.875013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:55.875459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:55.876243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:55.876674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:56.001103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:56.009362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-927930dc-9681-44a5-aa2b-4c7e60f74857 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145308 Jul 20 14:10:56.009913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1314/2419] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:55 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:56.326174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:56.326720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:56.333762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:56.334208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:56.334969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:56.335399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:56.399068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:56.406894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89c7f358-edf4-418b-b65b-1a33ec09d8a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084630 Jul 20 14:10:56.407450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1106/2420] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:57.027017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:57.027617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:57.034024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:57.034462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:57.035207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:57.035632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:57.163996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:57.166152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:57.173146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-84ae36af-0131-498a-ba82-d01ebb5ecac7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149995 Jul 20 14:10:57.173701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1315/2421] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:57 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:57.424630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:57.425232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:57.432233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:57.432684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:57.433435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:57.433865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:57.448129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:57.499052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:57.506915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b06ecf57-42fd-47ad-94b2-5630ce2ddb35 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086066 Jul 20 14:10:57.507477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1107/2422] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:57 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:58.190531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:58.191120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:58.197628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:58.198078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:58.198834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:58.199267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:58.324285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:58.332033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9e4570bf-508c-45ee-b736-d56b3ef45bd5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145466 Jul 20 14:10:58.333147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1316/2423] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:58 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:58.523517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:58.524056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:58.530255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:58.530693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:58.531442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:58.531865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:58.595353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:58.604184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3daf47bd-9265-460c-a8f8-e0e6ac312c2b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085170 Jul 20 14:10:58.604776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1108/2424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:59.349812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:59.350430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:59.357256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:59.357708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:59.358467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:59.358900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:59.486003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:59.494447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5434a539-c1fc-4eb9-9892-846e3b5465f4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148552 Jul 20 14:10:59.495015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1317/2425] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:59 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:10:59.620952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:10:59.621478 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:10:59.627912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:59.628399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:59.629152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:10:59.629588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:10:59.690032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:10:59.697815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3db0255e-e12f-425a-84ce-4c5ae9d4006c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080899 Jul 20 14:10:59.698368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1109/2426] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:10:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:00.511850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:00.512599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:00.519442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:00.520645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:00.521596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:00.522071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:00.655954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:00.664431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b537c6f5-7880-433c-86f2-31eda39cf398 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.156946 Jul 20 14:11:00.665007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1318/2427] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:00 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:00.714563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:00.715225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:00.721684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:00.722130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:00.723467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:00.723899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:00.782867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:00.791703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9525855f-7e55-4fd9-b687-61eef9c802dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081234 Jul 20 14:11:00.792293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1110/2428] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:01.681628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:01.682233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:01.688662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:01.689105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:01.689860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:01.690294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:01.808279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:01.808927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:01.815461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:01.815956 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:01.816096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:01.816734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:01.817166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:01.823855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c819eb0c-47ed-4686-9463-19f119fed475 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146120 Jul 20 14:11:01.824441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1319/2429] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:01 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:01.877565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:01.885292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ee9ba908-2f6f-4f3f-8e81-12953b95787e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080902 Jul 20 14:11:01.885845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1111/2430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:02.841804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:02.842331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:02.848782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:02.849230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:02.849982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:02.850413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:02.901330 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:02.901937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:02.908418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:02.908868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:02.909628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:02.910063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:02.973146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:02.980655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-242a580d-965c-4d4e-b2a6-d46b1657d9c4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083139 Jul 20 14:11:02.981226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1112/2431] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:02.982757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:02.991026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5a66335d-0177-4aa2-be3c-421d4b5a90db tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153190 Jul 20 14:11:02.991579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1320/2432] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:02 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:03.997939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:03.998541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:04.005575 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:04.006018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:04.006769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:04.007196 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:04.008570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:04.009181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:04.015458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:04.015900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:04.016990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:04.017422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:04.069893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:04.077815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-51ca0fba-e9f4-4caa-9ca6-55fd3e918633 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083685 Jul 20 14:11:04.078386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1113/2433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:04.142946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:04.150883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ce7d0e70-4252-4f7b-bf0e-bcc13317fad9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146764 Jul 20 14:11:04.151441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1321/2434] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:04 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:05.095232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:05.095835 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:05.102308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:05.102747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:05.103494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:05.103925 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:05.163194 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:05.168065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:05.168696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:05.171374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-50aceebe-f5b7-464d-837d-972753fe1ffe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079896 Jul 20 14:11:05.172063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1114/2435] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:05.175400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:05.176239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:05.177010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:05.177441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:05.303561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:05.311445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5d80e25b-b3e4-4b46-8852-4216c7d9527e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147146 Jul 20 14:11:05.312010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1322/2436] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:05 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:06.188658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:06.189264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:06.196303 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:06.196752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:06.197511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:06.197950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:06.258099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:06.265848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-095424b4-84ee-4e62-b151-acb866cdf5ab tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081142 Jul 20 14:11:06.266416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1115/2437] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:06.329117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:06.329740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:06.337110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:06.337568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:06.338351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:06.338785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:06.470633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:06.478494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6bd5d313-e258-4370-ba34-0c3ad1dee0c2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153310 Jul 20 14:11:06.479052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1323/2438] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:06 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:07.283097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:07.283710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:07.290791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:07.291238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:07.291998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:07.292462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:07.355164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:07.363040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-08153031-c65a-4e82-88ea-c5c86ab4163c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083833 Jul 20 14:11:07.363617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1116/2439] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:07.495339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:07.495968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:07.502346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:07.502782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:07.503522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:07.503946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:07.632388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:07.640434 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9b9ca0e6-328c-4092-9af0-f6f2112cb73a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148844 Jul 20 14:11:07.641000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1324/2440] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:07 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:08.379237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:08.380436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:08.386976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:08.387426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:08.388216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:08.388651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:08.448455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:08.456384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1b3991c2-bdb5-457a-a31c-41a76727746a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080921 Jul 20 14:11:08.456939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1117/2441] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:08.657997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:08.658594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:08.665778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:08.666218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:08.666967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:08.667394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:08.795534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:08.803388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bc667374-03ba-427a-8a27-a8268359b35e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149212 Jul 20 14:11:08.803949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1325/2442] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:08 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:09.473265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:09.473968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:09.480707 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:09.481145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:09.481894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:09.482319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:09.542259 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:09.549972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e4043fc4-4aab-414c-b6f4-945d66cb4c7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080583 Jul 20 14:11:09.550535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1118/2443] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:09.820865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:09.821418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:09.827790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:09.828254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:09.829006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:09.829430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:09.954777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:09.963527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b9d07078-4c5c-4c04-98e8-b7db96bdb5de tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147158 Jul 20 14:11:09.964356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1326/2444] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:09 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:10.567338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:10.567971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:10.575176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:10.575654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:10.576475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:10.576931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:10.640244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:10.649160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3a976ee0-c78b-4dc4-8a84-fe1ff8f730b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085897 Jul 20 14:11:10.649681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1119/2445] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:10.980875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:10.981496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:10.988498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:10.988973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:10.989753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:10.990190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:11.125105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:11.133673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ec8b2faf-9769-4e84-8404-925ff750bf9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.156788 Jul 20 14:11:11.134235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1327/2446] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:10 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:11.666420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:11.667023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:11.673797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:11.674450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:11.675450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:11.675881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:11.744008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:11.751884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b19ebb48-ad82-4e1d-a52e-1acea319f5a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.089558 Jul 20 14:11:11.752482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1120/2447] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:12.151139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:12.151742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:12.158160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:12.158601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:12.159361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:12.159792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:12.285578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:12.293419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bff88450-4056-48db-a9cc-f8526fe9a05b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146173 Jul 20 14:11:12.293974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1328/2448] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:12 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:12.768576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:12.769180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:12.775592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:12.776068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:12.776855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:12.777290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:12.837210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:12.844962 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0540ba3f-fc75-4f93-85b9-afdebbd9b948 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080214 Jul 20 14:11:12.845520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1121/2449] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:13.309697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:13.310331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:13.316984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:13.317432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:13.318191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:13.318625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:13.444817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:13.452527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-48cf40f8-a235-4bd0-b106-e81a81a84951 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146749 Jul 20 14:11:13.453086 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1329/2450] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:13 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:13.861650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:13.862258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:13.868788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:13.869244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:13.870004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:13.870441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:13.929895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:13.937672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f2127d1e-45d6-40ae-b8b4-be65ff011d0e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079888 Jul 20 14:11:13.938236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1122/2451] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:14.470052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:14.470654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:14.477156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:14.477594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:14.478333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:14.478758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:14.609398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:14.617178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bce8e46a-f9f9-4325-824e-16a32270b3d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150946 Jul 20 14:11:14.617737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1330/2452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:14 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:14.954750 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:14.955362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:14.962506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:14.962955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:14.963716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:14.964152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:15.024755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:15.032894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-38e4ee30-2305-41db-8d00-9b83c9672edd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082011 Jul 20 14:11:15.033446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1123/2453] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:15.634838 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:15.635479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:15.641938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:15.642373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:15.643121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:15.643542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:15.771021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:15.778762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9987e5d6-07c7-4fca-9177-a5b590f98dcb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147912 Jul 20 14:11:15.779316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1331/2454] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:15 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:16.050389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:16.051025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:16.058068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:16.058509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:16.059258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:16.059685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:16.063504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:16.123071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:16.130840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-743a389f-5a09-46c2-847f-61c819e1b7a6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084423 Jul 20 14:11:16.131394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1124/2455] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:16.795741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:16.796377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:16.802937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:16.803386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:16.804142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:16.804684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:16.820645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:16.935727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:16.944107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3f471478-8eda-4d9d-89ce-d3ae6ba7292b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152184 Jul 20 14:11:16.944691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1332/2456] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:16 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:17.147609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:17.148155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:17.154585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:17.155031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:17.155786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:17.156238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:17.463616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:17.471484 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-929b778e-b4f5-4f29-82f0-34be8fd6f952 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.327798 Jul 20 14:11:17.472038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1125/2457] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:17.962468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:17.963065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:17.965062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:17.970237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:17.970676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:17.971418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:17.971847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:18.097186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:18.105752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4d0a0ba9-1097-48ab-87a9-2125f4c9e3b5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147971 Jul 20 14:11:18.106307 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1333/2458] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:17 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:18.488451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:18.489055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:18.491308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=56 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:18.496710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:18.497149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:18.498095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:18.499017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:18.565220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:18.575147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-44a2c45f-30fa-4d50-9cef-cf21992e78b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.090524 Jul 20 14:11:18.575721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1126/2459] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:18 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:19.122897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:19.123494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:19.129945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:19.130388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:19.131137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:19.131568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:19.257315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:19.265155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eff2c835-7fe3-43c7-a69e-bb85275ec67b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146111 Jul 20 14:11:19.265715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1334/2460] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:19 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:19.591121 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:19.591738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:19.598219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:19.598665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:19.599423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:19.600479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:19.660051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:19.668522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fbf6c9de-554f-4c0c-8709-e5a3eb8e2a05 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081205 Jul 20 14:11:19.669084 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1127/2461] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:20.282665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:20.283275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:20.290407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:20.290886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:20.291644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:20.292081 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:20.419457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:20.427285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4cc235d7-bc9d-4b22-9dcd-c6c46f17c27a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148431 Jul 20 14:11:20.427871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1335/2462] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:20 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:20.685210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:20.685757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:20.692501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:20.692949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:20.694209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:20.694639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:20.754951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:20.770772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b173c210-d566-40bb-a2ce-b22f97c8af98 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.089101 Jul 20 14:11:20.771346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1128/2463] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:20 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:21.444698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:21.445302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:21.451841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:21.452257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:21.453018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:21.453453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:21.579295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:21.587928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e0094a76-7de2-4c6d-8c94-201000f0d0c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147106 Jul 20 14:11:21.588527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1336/2464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:21 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:21.786825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:21.788030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:21.794641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:21.795089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:21.795850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:21.796320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:21.858757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:21.866629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6eca53bc-956e-4c10-804a-a7be2a360443 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083688 Jul 20 14:11:21.867197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1129/2465] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:22.605595 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:22.606205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:22.612715 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:22.613163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:22.613923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:22.614354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:22.744656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:22.752651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c9ecd150-7ccf-4730-aa68-7cfb533e7d78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150939 Jul 20 14:11:22.753224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1337/2466] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:22 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:22.883181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:22.883710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:22.890112 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:22.890557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:22.891308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:22.891738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:22.950441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:22.958123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6e9f97b1-bb7b-46fe-a1c9-402ca3f6b781 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.078806 Jul 20 14:11:22.958676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1130/2467] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:23.769480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:23.770080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:23.776982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:23.777424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:23.778168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:23.778593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:23.905896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:23.914241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a8119257-682f-42f2-b4fe-585503503647 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148613 Jul 20 14:11:23.914793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1338/2468] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:23 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:23.975995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:23.976627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:23.983062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:23.983506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:23.984287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:23.984722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:24.044278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:24.052032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7573ab50-f7f6-475f-9bb4-829e2a2b6fde tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080536 Jul 20 14:11:24.052628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1131/2469] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:24.931520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:24.932134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:24.938605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:24.939055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:24.939813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:24.940269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:25.068317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:25.068558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:25.069263 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:25.075616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:25.076072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:25.076888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:25.077324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:25.077439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8722ebf6-1d63-478b-97df-89b48efcb8c1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150334 Jul 20 14:11:25.077913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1339/2470] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:24 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:25.142163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:25.150273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-86e70372-5483-4cdb-86f3-902f3ed848dd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085677 Jul 20 14:11:25.150843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1132/2471] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:26.094821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:26.095407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:26.101874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:26.102311 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:26.103055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:26.103477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:26.166789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:26.167501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:26.174011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:26.174535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:26.175374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:26.175899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:26.230667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:26.238943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5a32eaee-0aa6-42a4-8813-0669885a4604 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147858 Jul 20 14:11:26.239617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1340/2472] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:26 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:26.241563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:26.249644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8622ee32-7548-4bf9-8b95-53a6cf13ac08 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086685 Jul 20 14:11:26.250205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1133/2473] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:27.257477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:27.258205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:27.265244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:27.265697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:27.266467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:27.266904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:27.267019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:27.268062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:27.276761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:27.277210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:27.277978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:27.278549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:27.341024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:27.348904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0a9c3389-3bc6-463b-9158-c458f9ad2ac7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086097 Jul 20 14:11:27.349467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1134/2474] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:27.396652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:27.405170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-46b2679a-fd9b-4833-9c65-7c3c91509b93 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152473 Jul 20 14:11:27.405730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1341/2475] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:27 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:28.365769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:28.366425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:28.372708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:28.373149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:28.373899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:28.374329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:28.421953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:28.422657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:28.429188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:28.429635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:28.430469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:28.430907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:28.434040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:28.441881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fe08c12f-f6f1-47c5-95d2-6b6c89034853 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080059 Jul 20 14:11:28.442448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1135/2476] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:28.561977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:28.571183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1ffaafaa-0793-4aa8-9523-95e72c50f023 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152891 Jul 20 14:11:28.571784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1342/2477] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:28 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:29.457833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:29.458778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:29.465238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:29.465687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:29.466451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:29.466887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:29.528204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:29.536090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-80f0cebd-9cef-4f11-9c8e-0884403a246a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082141 Jul 20 14:11:29.536680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1136/2478] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:29.588111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:29.588748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:29.595163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:29.595615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:29.596408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:29.596849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:29.723974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:29.732590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e3aa3c7e-d9a1-4d14-874f-ee22642c28bc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148704 Jul 20 14:11:29.733154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1343/2479] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:29 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:30.552347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:30.552881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:30.559724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:30.560157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:30.560932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:30.561356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:30.627195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:30.635715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f23ba75d-ff1e-4abd-a7e8-690e5acab07c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087303 Jul 20 14:11:30.636681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1137/2480] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:30.749411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:30.750025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:30.756644 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:30.757703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:30.758505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:30.758948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:30.891356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:30.899278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e20d5c76-00e4-4e94-9404-593f7f5eba2c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153735 Jul 20 14:11:30.899837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1344/2481] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:30 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:31.652644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:31.653251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:31.660082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:31.660565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:31.661317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:31.661749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:31.721539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:31.729970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a436db1f-f786-4015-8d09-10e536ffb163 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081172 Jul 20 14:11:31.730539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1138/2482] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:31.918076 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:31.918682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:31.925248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:31.925701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:31.926467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:31.926901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:32.052905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:32.060703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1f3abec7-a28d-4a13-9eba-fe4070f1f77f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148359 Jul 20 14:11:32.061267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1345/2483] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:31 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:32.747119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:32.747778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:32.754499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:32.754967 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:32.755813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:32.756290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:32.827643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:32.835526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7f847e0e-4a7c-4939-8e9e-f247f3244539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.092301 Jul 20 14:11:32.836366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1139/2484] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:33.041038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:33.041571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:33.047965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.048457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.049222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.049659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.075446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:11:33.077446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:33.078052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:33.083972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.084871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.085633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.086320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.154875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c5eacff4-9e53-4d05-b227-9bea9a79a813 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 204 len: 0 microversion: 2.20 time: 0.117000 Jul 20 14:11:33.155741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1346/2485] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 14:11:33 2022] DELETE /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 14:11:33.164875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:33.165567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:33.171773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.172261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.173044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.173527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.189544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:33.224868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:33.227572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:33.234983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c8ee994-8577-49b7-8c62-3f470d9bccb6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.161279 Jul 20 14:11:33.235553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1140/2486] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:33 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:33.310039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:33.318039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:33.319563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:33.320749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d6d3dd5e-abce-422f-9546-24a7cdc697b5 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1722 microversion: 2.20 time: 0.160760 Jul 20 14:11:33.321299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1347/2487] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:11:33 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:11:33.852299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:33.852911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:33.859344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.859787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.860578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:33.861007 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:33.920843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:33.928620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e65ed73b-ec88-4b6f-9529-541bc4f766b6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080547 Jul 20 14:11:33.929193 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1141/2488] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:34.252578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:34.253147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:34.260332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:34.260787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:34.261545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:34.261981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:34.339179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:34.339787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:34.345749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:34.346192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:34.346948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:34.347376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:34.388842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:34.396786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ab54909e-8128-4b86-86c0-2997990dca96 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148144 Jul 20 14:11:34.397393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1348/2489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:34 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:34.474431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:34.482251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:34.483747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:34.484909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-88c21633-2b50-4317-aeab-f8fe55ac377d tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1722 microversion: 2.20 time: 0.149972 Jul 20 14:11:34.485466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1142/2490] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:11:34 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:11:34.947137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:34.947747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:34.953713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:34.954168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:34.954929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:34.955361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:35.060458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:35.068261 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9ae62f23-b54c-4184-8119-dafb7938ac2f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.125410 Jul 20 14:11:35.068836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1349/2491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:35.413577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:35.414187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:35.421430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:35.421878 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:35.422634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:35.423068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:35.504061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:35.504653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:35.511300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:35.511917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:35.512537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:35.518219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:35.564496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:35.573000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-30ae4904-f7e1-4f4b-bb85-674d38aa6b86 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.163295 Jul 20 14:11:35.573760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1143/2492] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:35 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:35.594035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:35.602857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:35.604475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:35.605627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-08838046-8e0e-4085-ae14-b485233762f0 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 200 len: 1655 microversion: 2.20 time: 0.105687 Jul 20 14:11:35.606180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1350/2493] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:11:35 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 1655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 14:11:35.895127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-99d8d1c6-0dea-405e-bfa8-b548d7763367 req-5e7fe64d-0d07-4dcb-af8b-0b72c42d1bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d333753-3f98-4c38-b879-a134f8f7de72", "name": "network-vif-deleted", "tag": "dbe58ce8-e811-47ee-923a-01b2c71c23e6"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:11:35.904183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-99d8d1c6-0dea-405e-bfa8-b548d7763367 req-5e7fe64d-0d07-4dcb-af8b-0b72c42d1bf1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:35.904655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-99d8d1c6-0dea-405e-bfa8-b548d7763367 req-5e7fe64d-0d07-4dcb-af8b-0b72c42d1bf1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:35.927238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-99d8d1c6-0dea-405e-bfa8-b548d7763367 req-5e7fe64d-0d07-4dcb-af8b-0b72c42d1bf1 service nova] Creating event network-vif-deleted:dbe58ce8-e811-47ee-923a-01b2c71c23e6 for instance 8d333753-3f98-4c38-b879-a134f8f7de72 on hv-cinder-81914 Jul 20 14:11:35.932292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-99d8d1c6-0dea-405e-bfa8-b548d7763367 req-5e7fe64d-0d07-4dcb-af8b-0b72c42d1bf1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040697 Jul 20 14:11:35.933349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1144/2494] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:11:36.085987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:36.086564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:36.093659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:36.094113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:36.094901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:36.095335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:36.158827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:36.167268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-517e00ce-0f68-455e-a147-3eeffb658726 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085668 Jul 20 14:11:36.167837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1351/2495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:36.592135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:36.592869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:36.599276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:36.599846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:36.601029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:36.601471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:36.622975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:36.623593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:36.629976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:36.630637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:36.631393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:36.631988 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:36.646470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] HTTP exception thrown: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Request method failure captured: Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 HTTP/1.1 Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdhuJXNAbX8rwlzcFj8oh5gs5PcvAIJuqswdLVNDXB2-Z6P-0h35eJtyOSKUnM085Epek3ZVXgPia7-YZplhmUS8Qt_CqUHrIIyjGEnT656e_TrhVi8NEXpNBjvhijn4gbijhz6fbp839DYFp6euLjXLUL3dtDaPNE7xqHOQ1aaQus Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:11:36.649026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}] Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: f9cb52fe271348c1bc0ffda92063bf59 Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:36.650777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '8d333753-3f98-4c38-b879-a134f8f7de72'} Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:11:36.651720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:36.653263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:36.655812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Returning 404 to user: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:11:36.657077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-48c1748f-a3ae-4b3c-bea3-f1f80c6079e3 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 404 len: 111 microversion: 2.20 time: 0.038034 Jul 20 14:11:36.661425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1352/2496] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:11:36 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 14:11:36.666822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3306b3a0-9702-41a0-8eeb-50f48ec4031c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '.version_select at 0x7fa40d2425e0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:36.686910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3306b3a0-9702-41a0-8eeb-50f48ec4031c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-846180536" status: 204 len: 0 microversion: 2.20 time: 0.024156 Jul 20 14:11:36.687657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1353/2497] 10.222.0.17 () {60 vars in 1258 bytes} [Wed Jul 20 14:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-846180536 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 14:11:36.756357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:36.765661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2559ec80-4ad5-40c0-829d-91eb4cc531ce tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.177784 Jul 20 14:11:36.768617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1145/2498] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:36 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:37.183907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:37.184537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:37.190538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.191054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.192054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.192513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.286163 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:37.293999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f8dc5459-9478-437c-a358-dd0cb61dcf58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.114075 Jul 20 14:11:37.294562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1354/2499] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:37.351902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:37.352416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:37.358351 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.358793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.359578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.360006 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.373372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] HTTP exception thrown: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Request method failure captured: Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: DELETE /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 HTTP/1.1 Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdhuJXNAbX8rwlzcFj8oh5gs5PcvAIJuqswdLVNDXB2-Z6P-0h35eJtyOSKUnM085Epek3ZVXgPia7-YZplhmUS8Qt_CqUHrIIyjGEnT656e_TrhVi8NEXpNBjvhijn4gbijhz6fbp839DYFp6euLjXLUL3dtDaPNE7xqHOQ1aaQus Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:11:37.375029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}] Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: f9cb52fe271348c1bc0ffda92063bf59 Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.376744 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '8d333753-3f98-4c38-b879-a134f8f7de72'} Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:11:37.377647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.378848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.380106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Returning 404 to user: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:11:37.380106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c26ece4-8711-49e3-a6dc-dd86630df2ef tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 404 len: 111 microversion: 2.20 time: 0.028368 Jul 20 14:11:37.380106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1146/2500] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 14:11:37 2022] DELETE /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 14:11:37.385227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:37.385820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8d333753-3f98-4c38-b879-a134f8f7de72] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:37.391687 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.392125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.392952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.393365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.406172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] HTTP exception thrown: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Request method failure captured: Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 HTTP/1.1 Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdhuJXNAbX8rwlzcFj8oh5gs5PcvAIJuqswdLVNDXB2-Z6P-0h35eJtyOSKUnM085Epek3ZVXgPia7-YZplhmUS8Qt_CqUHrIIyjGEnT656e_TrhVi8NEXpNBjvhijn4gbijhz6fbp839DYFp6euLjXLUL3dtDaPNE7xqHOQ1aaQus Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:11:37.407722 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}] Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: f9cb52fe271348c1bc0ffda92063bf59 Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.409114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '8d333753-3f98-4c38-b879-a134f8f7de72'} Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:11:37.409859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. Jul 20 14:11:37.411439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:11:37.413400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Returning 404 to user: Instance 8d333753-3f98-4c38-b879-a134f8f7de72 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:11:37.413400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8551bb89-4d05-43b3-ae9d-2fea9fe76034 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72" status: 404 len: 111 microversion: 2.20 time: 0.028274 Jul 20 14:11:37.413400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1355/2501] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:11:37 2022] GET /compute/v2.1/servers/8d333753-3f98-4c38-b879-a134f8f7de72 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 14:11:37.782086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:37.782687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:37.789656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.790095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.790840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:37.791264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:37.920183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:37.927939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f3d9245e-8821-482f-9e0e-53a2ca1edee7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149670 Jul 20 14:11:37.929082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1147/2502] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:37 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:38.310792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:38.311316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:38.317638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:38.318079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:38.319321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:38.319835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:38.379578 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:38.387756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f82815c9-39e2-46b7-9250-79c68a8d199f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080895 Jul 20 14:11:38.388330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1356/2503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:38 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:38.946824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:38.947436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:38.953930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:38.954383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:38.955144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:38.955580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:39.084361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:39.092944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6bc4f6d5-5cf4-43f7-b160-5f8ac18e253b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150836 Jul 20 14:11:39.093506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1148/2504] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:38 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:39.404461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:39.405068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:39.411495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:39.411949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:39.412740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:39.413174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:39.473678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:39.481673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c77ba25c-1fd5-4b07-88ac-a377ec7c8fec tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081077 Jul 20 14:11:39.482226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1357/2505] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:40.110751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:40.111346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:40.118492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:40.118930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:40.119678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:40.120100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:40.248833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:40.257461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-dfabd8ed-83e5-4599-a5f9-05488d3a9759 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149873 Jul 20 14:11:40.257461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1149/2506] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:40 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:40.498818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:40.499429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:40.505930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:40.506377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:40.507169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:40.507609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:40.570037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:40.579526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c344c9ad-d1fc-4511-9e72-559006d2264f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084408 Jul 20 14:11:40.580317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1358/2507] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:41.273114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:41.273722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:41.280430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:41.280882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:41.281640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:41.282073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:41.406208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:41.414572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-58816082-ef29-483a-b657-7eb57dfe19e0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145344 Jul 20 14:11:41.415141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1150/2508] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:41 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:41.597482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:41.598019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:41.605252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:41.605709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:41.606470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:41.606906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:41.672904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:41.681551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1b02fca5-c28a-4e31-812b-5f60459d2982 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.088065 Jul 20 14:11:41.682114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1359/2509] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:42.431816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:42.432447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:42.438893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:42.439338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:42.440090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:42.440546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:42.584511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:42.593179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-df5f4f8b-3d5d-44d3-924f-66181725cb12 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.165629 Jul 20 14:11:42.593852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1151/2510] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:42 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:42.698179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:42.698958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:42.705553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:42.705995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:42.706763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:42.707194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:42.798226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:42.806520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-56a72227-7f71-4dee-890b-8021e62d23a7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.112890 Jul 20 14:11:42.807084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1360/2511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:42.972368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-075f85c4-1fe5-460f-8b3f-395b7b17b794 req-4dfaa621-fb7d-4ae0-af4b-0188eba73e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf47794-d975-439d-85ed-1a2fd9cbd791", "name": "network-vif-deleted", "tag": "6f5ebde4-025c-4b7b-9d4b-bab82c242c99"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:11:42.981428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-075f85c4-1fe5-460f-8b3f-395b7b17b794 req-4dfaa621-fb7d-4ae0-af4b-0188eba73e3f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:42.981961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-075f85c4-1fe5-460f-8b3f-395b7b17b794 req-4dfaa621-fb7d-4ae0-af4b-0188eba73e3f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:42.993436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-075f85c4-1fe5-460f-8b3f-395b7b17b794 req-4dfaa621-fb7d-4ae0-af4b-0188eba73e3f service nova] Creating event network-vif-deleted:6f5ebde4-025c-4b7b-9d4b-bab82c242c99 for instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 on hv-cinder-81914 Jul 20 14:11:42.998514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-075f85c4-1fe5-460f-8b3f-395b7b17b794 req-4dfaa621-fb7d-4ae0-af4b-0188eba73e3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029952 Jul 20 14:11:42.999114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1152/2512] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:11:43.609939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:43.610419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:43.616607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:43.617057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:43.617817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:43.618251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:43.748565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:43.757098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-92c8330b-259f-42fd-9ef0-5b721d7b580e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151160 Jul 20 14:11:43.757662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1361/2513] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:43 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:43.824473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:43.825174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:43.831308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:43.831737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:43.832518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:43.832956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:43.897737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:43.905630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-12ddc3c0-5727-4683-bc3b-c20306fc87a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085882 Jul 20 14:11:43.906199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1153/2514] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:44.774318 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:44.774926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:44.781368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:44.781812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:44.782572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:44.782998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:44.907443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:44.915905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-72740037-d3d4-498e-824b-a05687e11164 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145915 Jul 20 14:11:44.916507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1362/2515] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:44 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:44.921983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:44.922622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:44.929101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:44.929555 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:44.930349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:44.930788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:44.990644 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:44.998482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5a4b431d-4a7a-480f-8c48-599259bd7ad9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080338 Jul 20 14:11:44.999042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1154/2516] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:45.933473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:45.934079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:45.940527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:45.940970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:45.941728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:45.942155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:46.014880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:46.015493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:46.021987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:46.022435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:46.023205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:46.023639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:46.074755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:46.082709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b668bd18-a14c-42e3-9785-44d99ac8b6ed tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153076 Jul 20 14:11:46.083295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1363/2517] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:45 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:46.089354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:46.097457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6ecf51be-d2aa-4ec6-828f-3246635540e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086441 Jul 20 14:11:46.098023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1155/2518] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:47.102453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:47.103104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:47.109839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:47.110007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:47.110745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:47.111177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:47.114649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:47.115260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:47.121824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:47.122273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:47.123034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:47.123468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:47.183876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:47.191999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f719bb0d-5428-4237-9c13-2ffaa2ef7053 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081110 Jul 20 14:11:47.192691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1156/2519] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:47.239356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:47.247164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-94835d87-12b1-444f-bf39-d6790a2033ec tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149998 Jul 20 14:11:47.247728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1364/2520] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:47 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:48.208827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:48.209494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:48.216122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:48.216599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:48.217361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:48.217796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:48.264413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:48.265031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:48.275190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:48.280871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:48.281314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:48.282089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:48.282520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:48.288240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:48.296349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-879f6a3a-d161-4ff3-9b02-ce3dd270db1f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.091466 Jul 20 14:11:48.297143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1157/2521] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:48.409907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:48.418217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-27461735-63b4-40cc-9461-eb7ba60390fa tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.157707 Jul 20 14:11:48.418777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1365/2522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:48 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:49.313719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:49.314317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:49.316734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=64 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:49.322991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:49.323433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:49.324181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:49.324632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:49.385948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:49.393955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cbc5d13c-44e8-4cd6-a7e9-72361cc647fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084062 Jul 20 14:11:49.394514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1158/2523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:49.434745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:49.435347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:49.441745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:49.442187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:49.442963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:49.443406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:49.458355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:49.579199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:49.587685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a5a7c3ed-70c4-4d2f-901b-d7ce67b166c4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.156771 Jul 20 14:11:49.588245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1366/2524] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:49 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:50.410107 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:50.410700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:50.417353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:50.417798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:50.418551 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:50.418984 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:50.433328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:50.479819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:50.487650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-39b1763a-cac9-49c3-918b-d3eba7516ff9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081379 Jul 20 14:11:50.488220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1159/2525] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:11:50.605322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:50.605957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:50.612416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:50.612867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:50.613626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:50.614073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:50.750925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:50.759300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-de964ef5-abac-4292-af0f-c81730705ba6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.157872 Jul 20 14:11:50.759854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1367/2526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:50 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:51.504219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:51.505229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:51.511643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:51.512085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:51.512866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:51.513296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:51.574374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:51.582116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ef5f1f01-32ba-41a3-a315-3d3a88a7e0a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081789 Jul 20 14:11:51.582681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1160/2527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:51.776227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:51.776757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:51.783232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:51.783680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:51.784469 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:51.784906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:51.915633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:51.923519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b820a715-c313-49e3-8ec2-bbff5812f862 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151795 Jul 20 14:11:51.924088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1368/2528] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:51 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:52.598751 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:52.599360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:52.605821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:52.606267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:52.607020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:52.607453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:52.673403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:52.681800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cb790ecf-1d4d-450b-8f7c-58702e7ead58 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086861 Jul 20 14:11:52.682371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1161/2529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:52.940872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:52.941479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:52.947987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:52.948513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:52.949218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:52.949650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:53.076221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:53.084074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0f5d6c0c-c85a-4a9a-8c48-17aab0782ab0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147037 Jul 20 14:11:53.084667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1369/2530] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:52 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:53.699447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:53.700051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:53.706708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:53.707160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:53.707922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:53.708412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:53.768684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:53.776556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ba7f789a-69c9-429b-b5ab-a74fcf2cfb9a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080933 Jul 20 14:11:53.777125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1162/2531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:54.102315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:54.102950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:54.109402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:54.109848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:54.110603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:54.111036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:54.239040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:54.247486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4f35c5af-472e-4cd2-9025-8e509c4a1875 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149539 Jul 20 14:11:54.248048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1370/2532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:54 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:54.793588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:54.794230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:54.800724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:54.801175 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:54.802020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:54.802463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:54.863360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:54.871993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cb963180-261c-4666-a1c7-810b561b90fb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082310 Jul 20 14:11:54.872597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1163/2533] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:55.264062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:55.264701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:55.271190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:55.271639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:55.272933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:55.273367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:55.400397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:55.408101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8421d291-c4c4-46ca-a983-31f36ea94e7e tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147892 Jul 20 14:11:55.408688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1371/2534] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:55 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:55.888380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:55.888924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:55.895229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:55.895673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:55.896437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:55.896867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:55.958472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:55.966676 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ee030618-3f2d-4edd-a1b6-c1b6a29dcddf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082221 Jul 20 14:11:55.967232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1164/2535] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:56.425756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:56.426388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:56.432974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:56.433421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:56.434178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:56.434623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:56.561867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:56.572098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1ebf567e-b5f7-4738-9a9a-16f52e7482d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150252 Jul 20 14:11:56.572696 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1372/2536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:56 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:56.982879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:56.983413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:56.989905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:56.990353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:56.991113 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:56.991546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:57.054990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:57.062872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1cc20269-eba5-446c-a67f-23a07af89f62 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083914 Jul 20 14:11:57.063440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1165/2537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:57.589519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:57.590123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:57.596607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:57.597047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:57.597797 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:57.598227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:57.728484 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:57.736350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fa7706cc-f3a3-49f1-8e7a-7f244cebff62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151212 Jul 20 14:11:57.736907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1373/2538] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:57 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:58.080450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:58.081055 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:58.088153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:58.088617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:58.089367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:58.089793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:58.149349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:58.157118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5fb3bcb7-6676-4fe2-b5d7-cb7c0289eb72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080765 Jul 20 14:11:58.157674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1166/2539] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:58.805552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:58.806155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:58.812633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:58.813075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:58.813829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:58.814264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:58.939791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:58.947598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-da065091-71a2-409c-a53c-2a72691f973f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146441 Jul 20 14:11:58.948167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1374/2540] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:58 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:59.173833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:59.174436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:59.180927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:59.181368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:59.182114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:59.182537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:59.243732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:11:59.251630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7fc35851-5596-4fee-8af4-6612a6cf629f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081710 Jul 20 14:11:59.252181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1167/2541] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:11:59.964008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:11:59.964640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:11:59.971114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:59.971564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:11:59.972345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:11:59.972782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:00.111191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:00.119788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ed2a7d76-25b4-4ffc-af01-085e3a040acd tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.160183 Jul 20 14:12:00.120385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1375/2542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:11:59 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:00.269008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:00.269533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:00.276064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:00.276525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:00.277284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:00.277717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:00.340522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:00.348282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2673770d-b3a4-45b1-aae3-8a029ac620ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083181 Jul 20 14:12:00.348845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1168/2543] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:01.136466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:01.137072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:01.143568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:01.144021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:01.144807 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:01.145238 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:01.275561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:01.283368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40c2b14b-216e-4ee2-9fb1-9122622a4121 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150802 Jul 20 14:12:01.283925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1376/2544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:01 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:01.365008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:01.365641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:01.372583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:01.373031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:01.373786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:01.374221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:01.436203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:01.444293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-70e8b09f-5de1-4915-9134-f6d13d9f2a9f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083172 Jul 20 14:12:01.445490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1169/2545] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:02.300911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:02.301525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:02.308656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:02.309108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:02.309866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:02.310306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:02.450936 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:02.459914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-768c781d-35ef-4e0e-bad8-42983e4f1a2a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.162790 Jul 20 14:12:02.460604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1377/2546] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:02 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:02.462009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:02.462610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:02.468949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:02.469391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:02.470117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:02.470542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:02.531029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:02.539124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b95c5d80-7ff0-404a-83de-e7251c194304 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081416 Jul 20 14:12:02.539685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1170/2547] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:03.478361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:03.478975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:03.485440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:03.485880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:03.486636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:03.487065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:03.554908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:03.555492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:03.561939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:03.562389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:03.563153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:03.563586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:03.621632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:03.624828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:03.629629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-97a406e7-0456-46d2-8dea-c4b374befd3c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.155777 Jul 20 14:12:03.631369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1378/2548] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:03 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:03.633067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b2afa755-e88e-4880-8feb-e7af3d097fc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081977 Jul 20 14:12:03.633774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1171/2549] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:04.646852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:04.647477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:04.649468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:04.650082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:04.654148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:04.654587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:04.655355 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:04.655781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:04.656599 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:04.657050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:04.657809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:04.658245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:04.719399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:04.728184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1f788b6d-4623-4478-bd63-a05d50c4edc6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082465 Jul 20 14:12:04.728783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1172/2550] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:04 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:04.784411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:04.792765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-40a1c860-3cf9-4a81-8e0d-41518ac55c07 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149876 Jul 20 14:12:04.793331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1379/2551] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:04 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:05.745373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:05.745972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:05.752773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:05.753218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:05.753974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:05.754406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:05.810544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:05.811151 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:05.817520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:05.817834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:05.818296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:05.819037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:05.819461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:05.825886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e2b181f7-db12-4a21-b6a0-d1daf1cc3a4e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084853 Jul 20 14:12:05.826457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1173/2552] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:05.878870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:12:05.879331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:12:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:12:05.951820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:05.959651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-18148eb8-3ade-4965-84a7-66b832053bb7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153282 Jul 20 14:12:05.960227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1380/2553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:05 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:06.842988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:06.843595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:06.850058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:06.850503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:06.851254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:06.851685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:06.911834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:06.919742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-720e785a-b6b4-45dc-89b5-3a087c6af4e2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080637 Jul 20 14:12:06.920326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1174/2554] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:06.977437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:06.978137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:06.984669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:06.985119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:06.985882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:06.986317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:07.114179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:07.122589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-199314a3-690e-4ca8-a4d3-1e796e732bf4 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149144 Jul 20 14:12:07.123152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1381/2555] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:06 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:07.936426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:07.937031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:07.943505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:07.943945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:07.944730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:07.945160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:08.007541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:08.015326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-67fef545-bcc4-45d3-80c1-702c0637dbfe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082801 Jul 20 14:12:08.015877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1175/2556] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:08.139598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:08.140254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:08.146713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:08.147157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:08.147919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:08.148393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:08.277583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:08.285462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b33cdc40-94b3-42f1-be05-97bee0b779a6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149682 Jul 20 14:12:08.286030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1382/2557] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:08 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:09.032645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:09.033247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:09.039730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:09.040172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:09.040954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:09.041875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:09.045682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:09.102335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:09.110661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aecca005-9ad3-40a6-a37d-e887a5f1a1ea tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081869 Jul 20 14:12:09.111218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1176/2558] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:09.303459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:09.304071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:09.312206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:09.312668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:09.313512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:09.313949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:09.318138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:09.441065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:09.448980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c2196bbe-0b49-4b23-9480-82f7328b4f01 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150143 Jul 20 14:12:09.449548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1383/2559] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:09 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:10.126947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:10.127592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:10.134094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:10.134541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:10.136037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:10.136489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:10.199683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:10.207512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7109d4e0-727d-4498-9390-5af49e7a1412 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084440 Jul 20 14:12:10.208063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1177/2560] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:10.465926 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:10.466526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:10.472949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:10.473411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:10.474136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:10.474561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:10.603293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:10.611658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae78ff51-4976-4a4c-a4f9-f6eb104ad505 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149606 Jul 20 14:12:10.612245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1384/2561] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:10 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:11.224354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:11.224972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:11.232503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:11.232953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:11.233793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:11.234252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:11.297573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:11.305911 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-459d472b-c844-45d7-95ae-f4d9ca99f311 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085393 Jul 20 14:12:11.306481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1178/2562] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:11.629386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:11.630213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:11.637114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:11.637292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:11.638062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:11.638492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:11.777001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:11.784932 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cbe4aad9-fb41-420f-b40a-151447712668 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.159508 Jul 20 14:12:11.785559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1385/2563] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:11 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:12.323963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:12.324636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:12.331118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:12.331562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:12.332355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:12.332791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:12.395280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:12.403183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a7a0829e-53b8-4f17-b9fb-119b50cff965 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083531 Jul 20 14:12:12.403742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1179/2564] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:12.802526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:12.803126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:12.810150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:12.810591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:12.811335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:12.811760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:12.937220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:12.945069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ff8c79ca-a987-492e-a7eb-5a73ee716231 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146375 Jul 20 14:12:12.945633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1386/2565] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:12 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:13.420413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:13.421005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:13.427701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:13.428143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:13.428976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:13.429412 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:13.490376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:13.501396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-29aed126-90bf-43ed-b49e-630d49edbd03 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085230 Jul 20 14:12:13.502746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1180/2566] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:13.791299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:12:13.791516 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:12:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:12:13.962284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:13.962891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:13.969906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:13.970354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:13.971109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:13.971540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:14.103828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:14.111845 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9984d67f-be21-4956-bebe-7d6eb0eaad40 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153563 Jul 20 14:12:14.112461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1387/2567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:13 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:14.520977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:14.521583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:14.529198 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:14.529641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:14.530420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:14.530851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:14.596833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:14.604659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-98f6d6c6-5508-47bb-98e7-0d4afa9b7137 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087461 Jul 20 14:12:14.605219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1181/2568] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:15.129317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:15.129924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:15.136413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:15.136854 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:15.137608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:15.138035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:15.265650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:15.273895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b93cebf1-71a1-44c3-bf92-659477d0f4b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148403 Jul 20 14:12:15.274474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1388/2569] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:15 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:15.620856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:15.621373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:15.628165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:15.628645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:15.629399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:15.629863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:15.690354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:15.698842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-24abf7ae-7e52-4c08-a90b-508dbc5b174d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082419 Jul 20 14:12:15.699406 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1182/2570] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:16.006268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:12:16.006461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:12:16.292147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:16.292718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:16.299202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:16.299640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:16.300428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:16.300857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:16.425282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:16.433129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3a311d0e-215f-4438-b4ad-dab3f9f1a003 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145565 Jul 20 14:12:16.433691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1389/2571] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:16 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:16.715964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:16.716597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:16.724161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:16.724665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:16.725498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:16.725978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:16.788503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:16.796466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3b771b0f-1868-4924-a5a7-d9cc191639bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084990 Jul 20 14:12:16.797041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1183/2572] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:17.450478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:17.451018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:17.457008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:17.457451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:17.458206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:17.458638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:17.587339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:17.595721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0b9cbf66-7da5-426a-9739-bdf62eecb977 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149386 Jul 20 14:12:17.596312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1390/2573] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:17 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:17.813036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:17.813576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:17.820307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:17.820786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:17.821557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:17.821992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:17.883282 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:17.891041 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9facef4f-199e-4de1-bc19-b00c91ea097c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082002 Jul 20 14:12:17.891595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1184/2574] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:18.615329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:18.616050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:18.618424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:18.623900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:18.624376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:18.625131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:18.625559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:18.753232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:18.761830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-103ba97e-327d-4498-87aa-d0b61ec33eb9 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152326 Jul 20 14:12:18.762327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1391/2575] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:18 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:18.907485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:18.908096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:18.914569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:18.915018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:18.915780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:18.916240 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:18.979266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:18.987156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9a496c67-02ff-4b02-91c5-15d9f3afa74d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083521 Jul 20 14:12:18.987706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1185/2576] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:18 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:19.778792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:19.779399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:19.786510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:19.786967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:19.787731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:19.788170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:19.921868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:19.929730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a637742d-7176-4217-9c8f-bc6350f835eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154784 Jul 20 14:12:19.930297 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1392/2577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:19 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:20.051696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:20.052342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:20.054251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=56 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:20.059573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:20.060028 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:20.060809 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:20.061244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:20.122293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:20.130092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-137f31dd-017f-4922-a3fc-f4bcc097790e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.131275 Jul 20 14:12:20.130643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1186/2578] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:20.946737 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:20.947345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:20.953694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:20.954141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:20.954893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:20.955326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:21.081425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:21.089603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d26ea8e5-f674-4caf-9a3d-557efedc0cad tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146791 Jul 20 14:12:21.090169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1393/2579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:20 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:21.146857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:21.147463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:21.153947 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:21.154392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:21.155148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:21.155586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:21.236468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:21.244299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-03a09f10-8008-4ba6-8474-4ce79995e834 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.101397 Jul 20 14:12:21.244855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1187/2580] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:22.106526 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:22.107116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:22.113718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:22.114166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:22.114919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:22.115353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:22.244054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:22.252467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-faffbe36-7dce-4555-9ac3-81e148751859 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149820 Jul 20 14:12:22.253033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1394/2581] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:22 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:22.260423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:22.261667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:22.268065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:22.268556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:22.269319 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:22.269754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:22.331094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:22.339169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9cf58a50-d806-404a-aea5-3f95261ef138 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082591 Jul 20 14:12:22.339730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1188/2582] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:23.270496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:23.271101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:23.277881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:23.278948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:23.279725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:23.280158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:23.356036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:23.356868 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:23.363736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:23.364146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:23.364955 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:23.365390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:23.413252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:23.421310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-65e92b31-0bb7-4101-8c38-a6e8e695a567 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154753 Jul 20 14:12:23.421923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1395/2583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:23 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:23.430073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:23.438092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-689ec2e7-63d1-47e4-abd9-d63bf4aa0c00 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085886 Jul 20 14:12:23.438653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1189/2584] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:24.439590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:24.440212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:24.446690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:24.447132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:24.447885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:24.448371 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:24.454587 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:24.455197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:24.461970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:24.462417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:24.463192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:24.463627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:24.524704 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:24.538550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-815e4d5b-31ad-41a3-8027-7d7c443212bf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087622 Jul 20 14:12:24.539140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1190/2585] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:24 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:24.577370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:24.585246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1f17d4a9-81d7-44ae-8e7d-8aa500acf616 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149541 Jul 20 14:12:24.586084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1396/2586] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:24 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:25.555662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:25.556309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:25.563352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:25.563798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:25.564586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:25.565021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:25.602840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:25.603828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:25.610502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:25.610950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:25.611748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:25.612182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:25.627187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:25.635296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a8fb300e-1f51-4408-8ec7-1a9026a0f038 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083375 Jul 20 14:12:25.635870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1191/2587] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:25.743249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:25.751602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fc96c57c-6ada-4066-b1e3-44d857875835 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152607 Jul 20 14:12:25.752160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1397/2588] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:25 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:26.651812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:26.652437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:26.659481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:26.659921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:26.660700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:26.661155 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:26.721860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:26.724040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:26.731784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7e64a74e-c128-4bd2-8490-054088a42aac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083100 Jul 20 14:12:26.732745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1192/2589] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:26.768843 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:26.769478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:26.775834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:26.776330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:26.777077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:26.777501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:26.907793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:26.915647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae31209f-67bd-42bf-a287-318ce4edd999 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150854 Jul 20 14:12:26.916224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1398/2590] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:26 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:27.749029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:27.749632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:27.756317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:27.756768 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:27.757522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:27.757956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:27.821811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:27.829748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d3dbbeb1-9641-42f8-b122-4d31851a9df6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085361 Jul 20 14:12:27.830306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1193/2591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:27.932678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:27.933312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:27.940381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:27.941561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:27.942344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:27.942753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:28.073353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:28.075562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:28.082620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-808641f0-f752-4934-bd3d-2902dc672f33 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153760 Jul 20 14:12:28.083179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1399/2592] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:27 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:28.847068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:28.847685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:28.854139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:28.854592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:28.855383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:28.855819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:28.918164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:28.926572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-26dbe75b-73b8-4384-9027-49156ae1749d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083311 Jul 20 14:12:28.927135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1194/2593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:29.100424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:29.101056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:29.107869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:29.108347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:29.109095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:29.109521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:29.242113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:29.250634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-943131a5-3aaf-48f1-9cff-d8179add1064 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154303 Jul 20 14:12:29.251194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1400/2594] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:29 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:29.942729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:29.943323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:29.949771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:29.950210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:29.950957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:29.951388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:30.013091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:30.020789 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-423f6489-e435-4fe5-97d5-7bcf00385309 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081872 Jul 20 14:12:30.021662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1195/2595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:30.268052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:30.268689 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:30.275125 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:30.275667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:30.276461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:30.276894 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:30.403774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:30.411579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a198899f-27d4-4c43-a2e3-2f584b699e36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147343 Jul 20 14:12:30.412138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1401/2596] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:30 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:31.038168 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:31.038774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:31.046095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:31.046540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:31.047299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:31.047734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:31.108180 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:31.115957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d5391bfc-18de-4de5-9cbe-813d2a82ceca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081767 Jul 20 14:12:31.116546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1196/2597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:31.428601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:31.429207 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:31.436126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:31.436600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:31.437353 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:31.437782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:31.564539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:31.572813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-49ae6c64-c6e6-43db-b696-cdd334155bab tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148112 Jul 20 14:12:31.573382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1402/2598] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:31 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:32.133171 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:32.133779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:32.140427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:32.140874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:32.141657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:32.142093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:32.204144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:32.212337 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8be18e5f-e773-4923-a8be-5e28e8f1518a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083485 Jul 20 14:12:32.212899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1197/2599] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:32.593218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:32.593818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:32.600462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:32.600910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:32.601673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:32.602107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:32.728170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:32.736138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-201f3cc9-2512-4c60-8e69-476cb992a7ea tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148030 Jul 20 14:12:32.736735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1403/2600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:32 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:33.228863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:33.229460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:33.236415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:33.236864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:33.237617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:33.238053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:33.297992 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:33.305791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-636174fa-502b-474b-9a22-f80e015833c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080795 Jul 20 14:12:33.306346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1198/2601] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:33.753610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:33.754225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:33.760719 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:33.761169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:33.761925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:33.762454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:33.891061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:33.898891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0bc85228-b2e9-4dbf-b78a-dd8c73856b78 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149125 Jul 20 14:12:33.899462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1404/2602] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:33 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:34.322432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:34.323034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:34.330206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:34.330649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:34.331402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:34.331832 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:34.391670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:34.399403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c3c47b99-36de-47c3-a0f8-12403789d882 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080915 Jul 20 14:12:34.399957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1199/2603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:34.916336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:34.916951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:34.923440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:34.923885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:34.924703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:34.925136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:35.054396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:35.062611 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7974653c-a30c-4370-945e-0a682ce6d0b0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150144 Jul 20 14:12:35.063177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1405/2604] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:34 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:35.415961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:35.416627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:35.423054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:35.423502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:35.424290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:35.424727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:35.485135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:35.492989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c3c58bb9-3291-427e-8a6f-eab3df6a2706 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080920 Jul 20 14:12:35.493553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1200/2605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:36.078849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:36.079459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:36.086240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:36.086692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:36.087449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:36.087889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:36.215100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:36.222917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e7c3992a-ead1-452a-bb40-96d592b5be89 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147942 Jul 20 14:12:36.223479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1406/2606] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:36 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:36.509592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:36.510203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:36.516769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:36.517216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:36.517975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:36.518408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:36.583633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:36.592399 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-49c7ff5d-e5e1-4042-940b-1b8b02a970a5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086709 Jul 20 14:12:36.592963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1201/2607] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:37.240388 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:37.241060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:37.247975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:37.248446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:37.249208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:37.250039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:37.374654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:37.382533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ec4a2684-a0d0-4d50-8c0a-225e39dcd78c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146015 Jul 20 14:12:37.383108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1407/2608] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:37 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:37.610547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:37.611156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:37.617723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:37.618176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:37.618936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:37.619369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:37.831639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:37.839692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6b1ee361-dc8a-48f0-92e6-e4189db76539 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.233465 Jul 20 14:12:37.840268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1202/2609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:38.399673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:38.400313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:38.407303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:38.407747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:38.408529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:38.408982 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:38.534386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:38.542230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8fff59d5-c4fd-4534-8cc7-a90d423e9dc1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146451 Jul 20 14:12:38.542810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1408/2610] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:38 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:38.855938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:38.857070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:38.863410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:38.863840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:38.864636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:38.865064 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:38.924085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:38.931915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c8653802-2fc4-46dd-b8cf-d8b335fc00ef tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079806 Jul 20 14:12:38.932488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1203/2611] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:38 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:39.559282 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:39.559947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:39.566474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:39.566916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:39.567676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:39.568107 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:39.698668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:39.707010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d1e66713-037a-4062-b9b1-80bd016cb9dc tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151660 Jul 20 14:12:39.707569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1409/2612] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:39 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:39.949098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:39.949718 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:39.956824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:39.957271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:39.958032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:39.958463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:40.019258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:40.028469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1fc51062-2fad-43a8-8e6e-74eb7b813d14 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083053 Jul 20 14:12:40.029096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1204/2613] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:40.725505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:40.726135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:40.733062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:40.733501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:40.734242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:40.734667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:40.859381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:40.867264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d85cb20b-2c4a-4c23-8556-83ce181ce41b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145643 Jul 20 14:12:40.867855 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1410/2614] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:40 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:41.046339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:41.046946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:41.053414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:41.053870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:41.054632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:41.055078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:41.118506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:41.127154 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d7b8fc68-456e-4d59-be87-da7af34fee92 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084684 Jul 20 14:12:41.127714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1205/2615] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:41.884937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:41.885536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:41.891970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:41.892446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:41.893202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:41.893634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:42.021970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:42.029801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fa533ebf-512b-44dc-92f8-47b1915f598c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148705 Jul 20 14:12:42.030360 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1411/2616] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:41 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:42.142732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:42.143247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:42.149721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:42.150168 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:42.150921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:42.151352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:42.211185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:42.219012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ec3359d8-2d31-43ea-bbaf-025a641ad738 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080212 Jul 20 14:12:42.219559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1206/2617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:43.047500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:43.048093 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:43.054635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:43.055088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:43.055852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:43.056318 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:43.182765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:43.190773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cb425606-a83d-4181-8d2e-59e5abeb70c8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147786 Jul 20 14:12:43.191420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1412/2618] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:43 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:43.235709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:43.236370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:43.242936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:43.243380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:43.244143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:43.244609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:43.306268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:43.313938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a8639174-37be-48c7-8e35-592f0b67de15 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082695 Jul 20 14:12:43.314480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1207/2619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:44.208165 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:44.208904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:44.215507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:44.216614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:44.217377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:44.217802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:44.331241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:44.331950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:44.338657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:44.339102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:44.339863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:44.340322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:44.347989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:44.355859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-880eae46-f74e-4743-be65-8e035d15f6d6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151579 Jul 20 14:12:44.356455 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1413/2620] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:44 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:44.400436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:44.408933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f0f67d9b-538a-46c1-8e8c-4dd9ea1ef384 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081718 Jul 20 14:12:44.409499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1208/2621] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:45.373732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:45.374340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:45.380900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:45.381349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:45.382109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:45.382642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:45.425401 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:45.425993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:45.432499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:45.432944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:45.433731 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:45.434169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:45.449369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:45.498958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:45.506764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7f6223ea-d61d-4a3a-b573-fedfd86b0ec9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085148 Jul 20 14:12:45.507333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1209/2622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:45.514828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:45.522856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aeeaaf80-3437-405a-97e9-43370794f67a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153580 Jul 20 14:12:45.523411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1414/2623] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:45 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:46.523913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:46.524546 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:46.532475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:46.532917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:46.533671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:46.534098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:46.539652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:46.540419 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:46.546551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:46.546996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:46.547753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:46.548185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:46.595458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:46.603597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0fd29454-18e4-40bb-b4f3-4161ae764ed6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083502 Jul 20 14:12:46.604395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1210/2624] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:46.676529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:46.684446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f5fa80c2-0b4a-4e42-8a91-6040e669622a tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148570 Jul 20 14:12:46.685006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1415/2625] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:46 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:47.620493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:47.621089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:47.627706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:47.628159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:47.628960 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:47.629397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:47.689598 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:47.697417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-afe30afe-d48e-4353-92f5-fecf8d199602 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080787 Jul 20 14:12:47.698152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1211/2626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:47.701496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:47.702099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:47.707947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:47.708429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:47.709180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:47.709609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:47.724708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:47.841904 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:47.850041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c5738a49-880d-4655-a337-8220676a60f7 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152622 Jul 20 14:12:47.850610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1416/2627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:47 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:12:48.714228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:48.714856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:48.721269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:48.721709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:48.722456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:48.722886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:48.782524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:48.790486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3b7e38ba-ac60-48ac-8329-9c83937fbada tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080400 Jul 20 14:12:48.791036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1212/2628] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:48.867891 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:48.868530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:48.870851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:48.876618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:48.877061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:48.877817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:48.878245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:49.004111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:49.012040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b4f1ad2a-bb3f-4398-91ac-950790391b9c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147946 Jul 20 14:12:49.012624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1417/2629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:48 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:49.808375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:49.808991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:49.815846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:49.816323 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:49.817109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:49.817535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:49.882309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:49.890702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3314fbcf-87a6-411c-9e89-e90bf62fc31b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086235 Jul 20 14:12:49.891250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1213/2630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:50.028732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:50.029340 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:50.036273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:50.036762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:50.037482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:50.037912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:50.167062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:50.175400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8efc1e86-f9a8-41ea-9ea6-397f34552e1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150598 Jul 20 14:12:50.175973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1418/2631] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:50 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:50.907262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:50.907859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:50.910418 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=56 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:50.915697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:50.916136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:50.916914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:50.917340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:50.977631 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:50.985807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-22bb782c-b60c-49f9-a358-e7a73e8e534c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082425 Jul 20 14:12:50.986352 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1214/2632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:51.193152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:51.193695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:51.201333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:51.201333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:51.202035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:51.202830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:51.331147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:51.339341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f81aea63-2843-4285-b254-6bf4e5978390 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150181 Jul 20 14:12:51.339911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1419/2633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:51 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:52.004700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:52.005720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:52.011511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:52.011954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:52.012743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:52.013176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:52.073114 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:52.081067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-98596475-398d-4982-ac97-b4ceea181f12 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080522 Jul 20 14:12:52.081745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1215/2634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:52.358401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:52.358935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:52.365475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:52.365916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:52.366669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:52.367098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:52.492391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:52.500325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7c7ba31a-0c44-4950-9a28-fa7630753b0f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146363 Jul 20 14:12:52.500895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1420/2635] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:52 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:53.098023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:53.098659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:53.105124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:53.105574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:53.106996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:53.107433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:53.166549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:53.174314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d22b946a-ddcd-492a-a07c-d66a3fe4dc24 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080180 Jul 20 14:12:53.174877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1216/2636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:53.518142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:53.518746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:53.525461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:53.525899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:53.526650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:53.527074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:53.656213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:53.664050 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6e927def-47d1-4fb6-b19e-bceabcba03ca tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149856 Jul 20 14:12:53.664655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1421/2637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:53 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:54.191408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:54.192004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:54.198404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:54.198841 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:54.199585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:54.200037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:54.262260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:54.270297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3aa5da06-a27d-4025-97ed-302f24b002ee tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082693 Jul 20 14:12:54.270861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1217/2638] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:54.680785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:54.681383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:54.687780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:54.688249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:54.688996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:54.689418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:54.813795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:54.821531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-90dea7ca-5c95-435b-bd49-9ff683dad3e3 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.144609 Jul 20 14:12:54.822087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1422/2639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:54 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:55.287275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:55.287879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:55.294294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:55.294729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:55.295500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:55.295924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:55.356567 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:55.364272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0185711d-cd12-4e75-9cde-3def8f81b0ac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080773 Jul 20 14:12:55.364821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1218/2640] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:55.839056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:55.839657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:55.846199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:55.846641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:55.847390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:55.847817 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:55.976795 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:55.984500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5376d75d-fccb-4767-a3e0-d55c6f199d36 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149498 Jul 20 14:12:55.985054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1423/2641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:55 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:56.381483 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:56.382034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:56.388446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:56.388903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:56.389660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:56.390096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:56.450803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:56.458664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f318b891-b41b-4a10-b3c7-ec3b6ab97481 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081161 Jul 20 14:12:56.459228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1219/2642] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:57.001367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:57.001976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:57.008441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:57.008898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:57.009659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:57.010096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:57.134921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:57.143414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0057c801-2bf3-4cee-a687-c733cb3b5d4c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145959 Jul 20 14:12:57.143980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1424/2643] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:56 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:57.475095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:57.475709 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:57.482376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:57.482822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:57.483586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:57.484021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:57.545990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:57.553964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-85290189-cf20-479b-bdf5-b36abe26a241 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083055 Jul 20 14:12:57.554525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1220/2644] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:57 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:58.161597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:58.162194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:58.169410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:58.169859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:58.170624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:58.171053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:58.299601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:58.307426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-544b8d77-76f3-4c37-aa6e-5c0b492a5f62 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149827 Jul 20 14:12:58.307996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1425/2645] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:58 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:58.570970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:58.571688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:58.579200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:58.579648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:58.580438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:58.580871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:58.645024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:58.653670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-88419277-a4be-4287-b046-cc3d98c63351 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086114 Jul 20 14:12:58.654222 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1221/2646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:59.324501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:59.325668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:59.332164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:59.332645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:59.333414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:59.333867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:59.459342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:59.468053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c49f15bd-c5e1-4bd8-afda-03074c005bc8 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147565 Jul 20 14:12:59.468632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1426/2647] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:59 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:12:59.669668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:12:59.670277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:12:59.676894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:59.677340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:59.678093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:12:59.678527 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:12:59.739005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:12:59.747413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ae91f191-ab5d-4f45-8cb4-d0a905cc4888 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081051 Jul 20 14:12:59.747969 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1222/2648] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:12:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:00.486637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:00.487224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:00.493584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:00.494022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:00.494765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:00.495191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:00.625172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:00.633159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9485b8df-d312-4fbd-949e-d6b5c804201f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150321 Jul 20 14:13:00.633739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1427/2649] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:00 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:00.764695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:00.765238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:00.772038 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:00.772514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:00.773270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:00.773701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:00.833360 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:00.841887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b1c5c51c-a827-4057-bc5a-83d551d9b939 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081634 Jul 20 14:13:00.842442 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1223/2650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:01.650619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:01.651144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:01.657655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:01.658097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:01.658849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:01.659278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:01.858413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:01.859045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:01.865933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:01.866377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:01.867151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:01.867583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:01.931334 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:01.939525 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ca452d3a-44c3-466d-846c-d3d2e9c5a114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085547 Jul 20 14:13:01.940108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1224/2651] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:13:02.027134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:02.035437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1decf6ca-2fac-4caf-8482-8ec11abe6594 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.388739 Jul 20 14:13:02.036003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1428/2652] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:01 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:02.955776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:02.956408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:02.963087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:02.963530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:02.964304 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:02.964733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:03.026620 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:03.034517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-db3b2c11-7b1e-4e8c-b2a6-41df097336e6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082660 Jul 20 14:13:03.035078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1225/2653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:03.052871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:03.053480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:03.060682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:03.061126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:03.061879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:03.062310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:03.188039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:03.195985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1eb27796-5013-4c0a-9362-75c52a4cdec2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146910 Jul 20 14:13:03.196588 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1429/2654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:03 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:04.051543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:04.052186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:04.058729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:04.059687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:04.060474 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:04.060916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:04.063410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:04.121221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:04.129491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b02bbd75-b06e-4788-9124-f6c08c0239fe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081823 Jul 20 14:13:04.130049 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1226/2655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:04 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:04.213486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:04.214122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:04.220590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:04.221040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:04.221802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:04.222237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:04.350114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:04.358435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-02a253a8-7991-4d0c-b07e-6a0acb53107f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149068 Jul 20 14:13:04.359008 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1430/2656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:04 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:05.146729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:05.147343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:05.154778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:05.155229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:05.155991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:05.156453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:05.219611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:05.227586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b4e65526-c246-4fb8-85cf-159e6cfbfd5f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084697 Jul 20 14:13:05.228151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1227/2657] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:05.374662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:05.375256 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:05.381691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:05.382131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:05.382876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:05.383301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:05.508777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:05.517329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0f38dede-0170-4d4e-bda0-f3b4eef54d15 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146464 Jul 20 14:13:05.517900 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1431/2658] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:05 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:06.243839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:06.244498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:06.251554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:06.251997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:06.252783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:06.253216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:06.313464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:06.321209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-68da1195-5544-4b0f-b6c2-478ef8bd04de tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081261 Jul 20 14:13:06.321782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1228/2659] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:06.535346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:06.535887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:06.542376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:06.542831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:06.544336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:06.544775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:06.684884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:06.692683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b0a488d6-aae4-4c41-97f3-016cbeb56d79 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.161664 Jul 20 14:13:06.693242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1432/2660] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:06 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:07.338111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:07.338723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:07.345819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:07.346322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:07.347103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:07.347533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:07.409368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:07.417097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f5da8cdb-cd17-4fdd-8ea5-14353884695b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083099 Jul 20 14:13:07.417667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1229/2661] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:07.710199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:07.711060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:07.717533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:07.717980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:07.718736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:07.719169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:07.723058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:07.846748 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:07.854648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f207f11c-605a-48f7-a3de-a1d340bebe49 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148293 Jul 20 14:13:07.855217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1433/2662] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:07 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:08.434609 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:08.435245 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:08.441804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:08.442252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:08.443010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:08.443446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:08.504205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:08.512604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-57267fa7-e6ba-400d-bae2-474b28c39415 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081262 Jul 20 14:13:08.513164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1230/2663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:08.870774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:08.871948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:08.878453 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:08.878899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:08.879654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:08.880085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:09.007200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:09.015049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a2eb06bf-b69d-43ac-ad2e-f6ad0e9ef383 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148134 Jul 20 14:13:09.015607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1434/2664] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:08 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:09.529204 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:09.529864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:09.536314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:09.536760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:09.537540 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:09.537974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:09.597623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:09.606093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c55caa0c-1f23-45d6-8b3d-284387a13e0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080245 Jul 20 14:13:09.606653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1231/2665] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:10.034660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:10.035328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:10.042069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:10.042514 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:10.043895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:10.044361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:10.173970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:10.181839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1dccb3ab-0895-4148-81fb-0b0dcdd02fde tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153059 Jul 20 14:13:10.182422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1435/2666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:10 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:10.623640 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:10.624260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:10.630978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:10.631496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:10.632311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:10.632742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:10.693327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:10.703033 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-70a3cf96-df83-493c-ae7c-09d22bc46b1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083185 Jul 20 14:13:10.703940 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1232/2667] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:11.198807 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:11.200001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:11.206994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:11.207631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:11.208447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:11.208907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:11.339113 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:11.348412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8248e291-4638-4a73-a724-77ad584ca2df tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153471 Jul 20 14:13:11.349019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1436/2668] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:11 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:11.720068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:11.720715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:11.727140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:11.727584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:11.728368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:11.728799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:11.792994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:11.800828 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-10689ec7-7698-42d2-8717-9c2e85cc22d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084582 Jul 20 14:13:11.801384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1233/2669] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:12.365727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:12.366369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:12.372867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:12.373321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:12.374078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:12.374515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:12.503691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:12.511552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b31f2736-6b7d-4afe-a31c-66b916dc4ec6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149788 Jul 20 14:13:12.512158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1437/2670] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:12 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:12.817488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:12.818099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:12.825017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:12.825467 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:12.826228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:12.826659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:12.886015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:12.894150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ec8c9753-2513-469b-bc57-5570b1be3e70 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080461 Jul 20 14:13:12.894702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1234/2671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:13.528643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:13.529177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:13.536541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:13.536986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:13.537759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:13.538189 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:13.670571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:13.678443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f6c2828e-840c-4777-897b-5ac4e31d8642 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153781 Jul 20 14:13:13.679007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1438/2672] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:13 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:13.910687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:13.911331 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:13.917759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:13.918769 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:13.919521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:13.919956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:13.980290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:13.988822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-02958761-b582-480f-a836-60c8e7660e73 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081970 Jul 20 14:13:13.989381 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1235/2673] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:14.695994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:14.696634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:14.703634 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:14.704082 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:14.704873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:14.705308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:14.831553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:14.839647 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-82b28f9c-5b37-46b0-b257-4802e8c58ab2 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147477 Jul 20 14:13:14.840273 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1439/2674] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:14 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:15.004617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:15.005219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:15.011514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:15.011957 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:15.012787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:15.013213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:15.073170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:15.081226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7a24d476-0b5c-41e4-b6c5-9cde46de1caf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080379 Jul 20 14:13:15.081782 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1236/2675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:15.857326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:15.857881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:15.865294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:15.865754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:15.866579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:15.867044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:16.020931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:16.029146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-58f62832-ff05-4e82-ae0d-059439f39480 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.176151 Jul 20 14:13:16.029827 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1440/2676] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:15 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:16.098052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:16.098742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:16.105390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:16.106607 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:16.107454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:16.107818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:16.179167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:16.187651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-02915e19-3ab9-40dc-9ed4-ae580cffe506 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.093506 Jul 20 14:13:16.188300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1237/2677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:17.047083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:17.047730 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:17.054458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:17.054922 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:17.055700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:17.056136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:17.187506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:17.195328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ea326942-dc6a-400d-9e59-a6a91530f685 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152297 Jul 20 14:13:17.195901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1441/2678] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:17 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:17.206349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:17.206975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:17.213683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:17.214137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:17.214905 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:17.215344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:17.275348 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:17.283427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7b26f2d7-67c2-4697-adce-e6f458ee1cf0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082896 Jul 20 14:13:17.284016 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1238/2679] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:18.212509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:18.213106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:18.220037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:18.220510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:18.221265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:18.221690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:18.300673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:18.301286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:18.308148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:18.308647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:18.309495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:18.309931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:18.354395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:18.362905 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-18a8a468-0a34-47f7-876d-faf11d228b90 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.154508 Jul 20 14:13:18.363476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1442/2680] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:18 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:18.371624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:18.379573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-06913fe6-c93f-4caa-a4b5-aab32dc04fa3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082893 Jul 20 14:13:18.380128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1239/2681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:18 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:13:19.379908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:19.380529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:19.382810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=52 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:19.388671 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:19.389121 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:19.389888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:19.390322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:19.395734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:19.396370 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:19.403543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:19.404111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:19.405004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:19.405625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:19.468274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:19.476318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d94defeb-8b4b-44f6-9dd0-99bad70a975c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084485 Jul 20 14:13:19.476884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1240/2682] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:19.520067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:19.528645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4cc5f05a-0b1b-46ec-b87f-80d312f846e1 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.152620 Jul 20 14:13:19.529188 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1443/2683] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:19 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:20.492732 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:20.493397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:20.499853 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:20.500329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:20.501088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:20.501520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:20.546375 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:20.547241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:20.554055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:20.554586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:20.555456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:20.555946 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:20.565783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:20.575220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0b2dd69d-0501-4728-8ea4-01c3271e0fa1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085768 Jul 20 14:13:20.575708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1241/2684] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:20 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:20.689762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:20.698837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-41737c24-5173-426a-97e7-39d3aee64b32 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.157082 Jul 20 14:13:20.700053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1444/2685] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:20 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:13:21.592265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:21.592907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:21.595223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=56 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:21.600548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:21.600998 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:21.601766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:21.602202 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:21.663067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:21.665296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:21.672810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f3c64dbd-1b71-4693-a20f-564af3c5955a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084534 Jul 20 14:13:21.673375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1242/2686] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:21.716965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:21.717565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:21.724321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:21.724763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:21.725512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:21.725940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:21.854508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:21.862303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e58bf2b6-65a1-4830-8fed-4ad452d6a93b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149409 Jul 20 14:13:21.862865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1445/2687] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:21 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:22.689859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:22.690462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:22.696989 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:22.697441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:22.698190 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:22.698621 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:22.758885 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:22.766758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a7be4d87-bfdb-468d-97b6-ad7ee87d9cac tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080778 Jul 20 14:13:22.767312 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1243/2688] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:22.879218 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:22.879819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:22.886383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:22.887450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:22.888227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:22.888662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:23.016834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:23.024757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6d23829c-6ccc-4a9d-bc82-1ec73d866d38 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.149446 Jul 20 14:13:23.025322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1446/2689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:22 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:23.783384 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:23.783978 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:23.790339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:23.790778 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:23.791519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:23.791948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:23.851800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:23.860101 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-62cdddcd-116f-4af3-9720-aa997eca0d71 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080525 Jul 20 14:13:23.860696 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1244/2690] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:24.040705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:24.041304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:24.048169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:24.048633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:24.049382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:24.049807 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:24.180329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:24.188686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a82ec12c-9964-4074-a193-f80735b250a5 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151809 Jul 20 14:13:24.189242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1447/2691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:24 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:24.877143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:24.877747 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:24.884136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:24.884610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:24.885376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:24.885790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:24.947777 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:24.956390 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-95033e0a-68cc-4bfd-a3d3-adfa1d8cedd6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083510 Jul 20 14:13:24.956956 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1245/2692] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:24 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:25.206296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:25.206840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:25.213576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:25.214024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:25.214780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:25.215217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:25.340680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:25.348466 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a5059c35-a55c-4920-943a-148bb8277136 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146096 Jul 20 14:13:25.349031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1448/2693] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:25 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:25.973843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:25.974482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:25.981580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:25.982024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:25.982780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:25.983213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:26.044846 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:26.052601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b070e6f2-c89e-473c-bf51-38d2573b7446 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082599 Jul 20 14:13:26.053163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1246/2694] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:26.366602 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:26.367149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:26.373752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:26.374202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:26.374958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:26.375414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:26.503899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:26.506109 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:26.513840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96e4e46a-8f9b-43e9-a788-d10fce8c90f0 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.151172 Jul 20 14:13:26.514408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1449/2695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:26 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:27.069742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:27.070341 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:27.077230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:27.077671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:27.078417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:27.078843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:27.139318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:27.147692 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a276c433-57b9-46a7-a712-7974048cdc2c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081773 Jul 20 14:13:27.148272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1247/2696] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:27.531155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:27.531752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:27.538342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:27.538786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:27.539568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:27.539994 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:27.666768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:27.674615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-20d1c6f8-d2a3-4183-ad69-6151d89c8f44 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.147808 Jul 20 14:13:27.675171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1450/2697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:27 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:28.164159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:28.164781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:28.170726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:28.171164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:28.171906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:28.172391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:28.232502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:28.240318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-14392211-c574-47d1-bbdf-8748651b9f82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080120 Jul 20 14:13:28.240872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1248/2698] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:28.691454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:28.692053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:28.698456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:28.698897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:28.699648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:28.700079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:28.828441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:28.836405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a26f2b28-e29b-459c-93ad-81f41c9df000 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148787 Jul 20 14:13:28.836960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1451/2699] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:28 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:29.258247 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:29.258941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:29.266357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:29.266834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:29.267726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:29.268209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:29.334445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:29.343164 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7c8fea0a-44fb-4459-b413-c8dba8a4a0a1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.089048 Jul 20 14:13:29.343752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1249/2700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:29.853957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:29.855807 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:29.862200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:29.862639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:29.863391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:29.863814 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:30.077072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:30.084950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2e87cfb6-bd76-435c-b7dc-8e63d4dbd87b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.234830 Jul 20 14:13:30.085509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1452/2701] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:29 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:30.359858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:30.360507 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:30.366990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:30.367502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:30.368284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:30.368721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:30.429860 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:30.437727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0b17083f-ffdf-4c6f-aec1-dfb8ffc3ff5a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081683 Jul 20 14:13:30.438288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1250/2702] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:31.103060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:31.103694 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:31.110098 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:31.110546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:31.111367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:31.112045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:31.241414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:31.249783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-70dffaad-6422-4c79-961c-05a6d0bc273f tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150652 Jul 20 14:13:31.250357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1453/2703] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:31 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:31.454403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:31.455004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:31.461767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:31.462220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:31.462979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:31.463415 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:31.523535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:31.531249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f43ecadc-d6da-410b-853d-917eb7d0c3b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080760 Jul 20 14:13:31.531953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1251/2704] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:32.266886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:32.267491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:32.273911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:32.274359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:32.275114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:32.275544 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:32.403334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:32.411106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f3caabb1-97e5-41e6-b279-aaa47565bb1b tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148117 Jul 20 14:13:32.411692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1454/2705] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:32 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:32.547594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:32.548157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:32.554643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:32.555093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:32.555852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:32.556313 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:32.617661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:32.625646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2b4d30a5-bfd1-4833-8a50-dfd7521088d9 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081950 Jul 20 14:13:32.626210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1252/2706] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:33.428883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:33.429459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:33.436773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:33.437212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:33.437957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:33.438380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:33.567088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:33.575541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-68afca1c-1f23-4a03-917c-515606f97d1c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.150526 Jul 20 14:13:33.576102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1455/2707] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:33 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:33.641481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:33.642087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:33.648659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:33.649103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:33.649863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:33.650294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:33.716039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:33.723822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f84d742e-3a52-43d7-b681-7f2e6d80771d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086185 Jul 20 14:13:33.724411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1253/2708] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:34.592064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:34.593345 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:34.599923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:34.600415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:34.601195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:34.601631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:34.740935 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:34.741636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:34.743268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:34.748669 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:34.749116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:34.749877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:34.750308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:34.751803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28253e63-0e3b-4114-ac45-a5ec01874c59 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.163606 Jul 20 14:13:34.752632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1456/2709] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:34 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:34.812888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:34.820684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ee1fae89-1c22-4b2d-ae3e-cb9800206368 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083660 Jul 20 14:13:34.821242 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1254/2710] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:13:35.769149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:35.769756 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:35.776271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:35.776727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:35.777487 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:35.777924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:35.838205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:35.838930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:35.845340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:35.845855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:35.846618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:35.847047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:35.906202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:35.907023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:35.914144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c9f795d3-2318-41a4-9e29-e7b8fca486b6 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.148838 Jul 20 14:13:35.914699 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-443239bf-7a0c-492e-8203-02d26d2c6bad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080610 Jul 20 14:13:35.914822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1457/2711] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:35 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:35.915249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1255/2712] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:13:36.931685 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:36.932266 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:36.932652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:36.932760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:36.939076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:36.939526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:36.939632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:36.939976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:36.940318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:36.940757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:36.940859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:36.941200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:37.002326 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:37.010071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6ce774b0-13f4-4cfc-acb3-b3176c3a9d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082248 Jul 20 14:13:37.010628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1256/2713] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:37.073292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:37.081793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-28b144a6-86aa-4673-946e-319cdb93eb27 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.153966 Jul 20 14:13:37.082369 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1458/2714] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:36 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:38.026760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:38.027366 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:38.033773 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:38.034236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:38.034981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:38.035404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:38.098451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:38.099164 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:38.099773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:38.106741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:38.106881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-77955ca9-0dfe-44d4-b4f2-6af170c44679 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083363 Jul 20 14:13:38.107186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:38.107601 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1257/2715] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:38 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:38.108092 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:38.108559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:38.233129 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:38.240872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d748f280-5a92-4251-9b22-f9b82e12b75d tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145740 Jul 20 14:13:38.241439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1459/2716] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:38 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:13:39.123428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:39.124045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:39.130505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:39.130959 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:39.131719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:39.132211 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:39.191458 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:39.199238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f4060d0f-7d0d-4abb-b604-0d7ba4a638fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080309 Jul 20 14:13:39.199802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1258/2717] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:39.258269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:39.258879 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:39.265259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:39.265704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:39.266456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:39.266887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:39.391796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:39.399605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6d54f164-7c80-4110-8d66-e90be1ba78eb tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.145131 Jul 20 14:13:39.400161 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1460/2718] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:39 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:40.216436 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:40.217050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:40.223489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:40.223933 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:40.224715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:40.225147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:40.239447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:40.287942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:40.296396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-46a5fa3b-698b-4d16-b9f2-342d74dfcceb tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083794 Jul 20 14:13:40.296954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1259/2719] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:40.417342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:40.417970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:40.429850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:40.430336 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:40.431149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:40.431603 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:40.570260 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:40.578096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6d79de57-eaea-4e98-8e9f-38a1d0e75016 tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.164881 Jul 20 14:13:40.578655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1461/2720] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:40 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:41.313300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:41.313900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:41.320519 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:41.320973 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:41.321733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:41.322169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:41.383577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:41.391900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-05e0c725-dc30-413d-8201-03c4462285b7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082502 Jul 20 14:13:41.392861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1260/2721] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:41.594808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:41.595352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] [instance: 5c2c93bf-5a33-4636-9cad-26c1f1464734] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:41.601786 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:41.602227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:41.602970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:41.603396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:41.729232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e5180dc37741919bc068f5e2302850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddc6ae060994d16b13ff53e80813e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:41.737062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c56989d9-16ee-441a-8464-56e59a58041c tempest-VolumesSnapshotTestJSON-1681230262 tempest-VolumesSnapshotTestJSON-1681230262-project] 10.222.0.17 "GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734" status: 200 len: 1558 microversion: 2.1 time: 0.146170 Jul 20 14:13:41.737625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1462/2722] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:41 2022] GET /compute/v2.1/servers/5c2c93bf-5a33-4636-9cad-26c1f1464734 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:42.409108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:42.409715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:42.416062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:42.416539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:42.417296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:42.417737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:42.480511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:42.489106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1d0fe8c6-7ee9-42a5-9a64-8ba955ae8eca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083938 Jul 20 14:13:42.489664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1261/2723] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:13:43.505870 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:43.506443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:43.512971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:43.513418 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:43.514180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:43.514617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:43.575681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:43.583559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7e6eca95-b0f6-4c3a-8f1c-4a80abffe8cc tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081590 Jul 20 14:13:43.584127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1463/2724] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:44.600646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:44.601234 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:44.607628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:44.608067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:44.608847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:44.609280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:44.669231 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:44.677108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fe87376e-88e0-47d4-9d97-09b7eca4517a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080318 Jul 20 14:13:44.677662 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1262/2725] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:45.694965 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:45.695483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:45.702471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:45.702924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:45.703680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:45.704114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:45.770071 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:45.777970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c0857114-482f-43cf-b80f-003a19bf92af tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087005 Jul 20 14:13:45.779184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1464/2726] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:46.795356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:46.795966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:46.802450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:46.802899 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:46.803657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:46.804093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:46.864124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:46.872127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d41316aa-21c1-47f6-8451-b2115b7c096c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080695 Jul 20 14:13:46.872730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1263/2727] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:47.889658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:47.890181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:47.896357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:47.896811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:47.897568 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:47.898001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:47.957248 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:47.965230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a10db132-a0ac-424b-b5dd-d45e7da3b6ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080077 Jul 20 14:13:47.965799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1465/2728] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:48.982502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:48.983682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:48.990469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:48.990916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:48.991673 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:48.992104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:49.051149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:49.058912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d1249164-1cb1-4b39-8cd3-20b2b70b1160 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080272 Jul 20 14:13:49.059469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1264/2729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:50.074896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:50.075504 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:50.077957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=46 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:50.083230 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:50.083660 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:50.084449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:50.084885 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:50.099999 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=100 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:50.147090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:50.154995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-08bb67db-b91d-4f5e-9a36-4642bc59e552 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083987 Jul 20 14:13:50.155554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1466/2730] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:51.171645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:51.172265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:51.178843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:51.179290 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:51.180039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:51.180489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:51.243325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:51.251844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6eded3be-7749-446b-bab0-86e21ce30e97 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084096 Jul 20 14:13:51.252450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1265/2731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:52.268893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:52.269457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:52.275851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:52.276341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:52.277100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:52.277534 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:52.338221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:52.347563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-790cba3a-d567-48e0-9b03-81bd8c36ff0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082598 Jul 20 14:13:52.348132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1467/2732] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:53.364339 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:53.364938 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:53.367392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=48 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:53.372526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:53.372966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:53.373740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:53.374166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:53.438377 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:53.446148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ab7000ec-566c-471a-abb4-3407e419c536 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085647 Jul 20 14:13:53.446719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1266/2733] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:54.302559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:13:54.303208 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:13:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:13:54.462876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:54.463482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:54.470952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:54.471404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:54.472162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:54.472620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:54.536953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:54.545149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f5eac21d-8db9-4137-a1df-c8088a3c8985 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086312 Jul 20 14:13:54.545713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1468/2734] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:54 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:55.562053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:55.562643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:55.570284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:55.570719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:55.571473 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:55.571898 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:55.639311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:55.647495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-312097cb-1c52-4ce3-a8ef-2ba59011fc8a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.089380 Jul 20 14:13:55.648057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1267/2735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:56.665034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:56.665642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:56.672106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:56.673214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:56.673974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:56.674408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:56.733662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:56.742625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-756a5735-193d-429a-9f03-dcc20a1ca89e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081221 Jul 20 14:13:56.743321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1469/2736] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:57.759726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:57.760363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:57.767335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:57.767783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:57.768566 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:57.769000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:57.834359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:57.842508 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ca623ff7-2ead-42a4-84a4-25f7971e8270 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087013 Jul 20 14:13:57.843066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1268/2737] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:57 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:58.860548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:58.861075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:58.867439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:58.867877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:58.868656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:58.869083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:58.929244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:13:58.936925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e7d175c2-bc82-41eb-8ef3-b8a947643ef8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081041 Jul 20 14:13:58.937486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1470/2738] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:13:59.953462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:13:59.954073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:13:59.960785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:59.961250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:13:59.962008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:13:59.962443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:00.026241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:00.034333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7d466b25-ec36-4a0e-97df-a05ac30f7e30 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084738 Jul 20 14:14:00.034926 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1269/2739] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:13:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:01.052877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:01.053490 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:01.060177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:01.060651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:01.061415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:01.061839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:01.124702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:01.133053 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b32979ac-d054-46ed-beaa-2b8d9f9512f0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085819 Jul 20 14:14:01.133608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1471/2740] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:02.150610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:02.151213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:02.158420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:02.158858 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:02.159603 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:02.160029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:02.219792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:02.227716 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7ec64941-61fa-4b8c-9b89-8d5fd7e7bd6d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080951 Jul 20 14:14:02.228287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1270/2741] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:03.244367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:03.244980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:03.251328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:03.251771 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:03.252555 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:03.252990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:03.316342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:03.324087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a3ebec86-58f4-486e-9ea7-983fcb1848b8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083624 Jul 20 14:14:03.324669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1472/2742] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:04.341643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:04.342250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:04.348771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:04.349210 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:04.349961 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:04.350385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:04.410570 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:04.418393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-04df23c1-0643-4768-9d59-216ea97b7fcf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080836 Jul 20 14:14:04.418951 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1271/2743] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:04 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:05.434998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:05.435609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:05.442872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:05.443331 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:05.444101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:05.444572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:05.506112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:05.513971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ed27ff1c-a2c0-404f-9f3c-2657d0151d72 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082956 Jul 20 14:14:05.514556 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1473/2744] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:05 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:06.533805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:06.534646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:06.541881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:06.542378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:06.543148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:06.543584 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:06.603409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:06.611195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d0f86e0c-69b9-4a61-965f-d7115cc82ef7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082705 Jul 20 14:14:06.611752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1272/2745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:07.626791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:07.627399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:07.633973 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:07.634423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:07.635190 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:07.635625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:07.695861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:07.703704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-018d3d05-d117-48ea-b99c-ff3ae5979206 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080797 Jul 20 14:14:07.704294 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1474/2746] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:08.720501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:08.721106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:08.727552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:08.727999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:08.728783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:08.729216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:08.794236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:08.802723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ff136061-a0f7-4e82-b551-447cf44cafad tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086066 Jul 20 14:14:08.803301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1273/2747] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:09.819292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:09.819893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:09.826327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:09.826766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:09.827510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:09.827944 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:09.888429 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:09.897337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-734606f4-61ff-4ad9-90cd-7ecfd3518dc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081847 Jul 20 14:14:09.897906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1475/2748] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:10.913850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:10.914456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:10.920912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:10.921356 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:10.922845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:10.923284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:10.927188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=88 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:11.221088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:11.228880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-170c42e9-abf1-4e47-a7c9-2e466ccf0db4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.318876 Jul 20 14:14:11.229437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1274/2749] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:12.245592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:12.246223 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:12.252899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:12.253346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:12.254102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:12.254532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:12.319122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:12.327060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6cd0585f-43ad-4106-b03c-013ff55f4456 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085337 Jul 20 14:14:12.327621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1476/2750] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:13.343946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:13.344494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:13.350927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:13.351376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:13.352139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:13.352600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:13.411758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:13.419488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-10371f29-3bef-408f-abc9-4926b7231433 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079505 Jul 20 14:14:13.420054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1275/2751] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:13.854836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:14:13.855339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:14:14.436800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:14.437910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:14.444478 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:14.444928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:14.445684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:14.446116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:14.508884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:14.517432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0568d97a-1608-43c5-a192-33bfb7275b9c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084605 Jul 20 14:14:14.517991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1477/2752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:14.715785 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:14:14.716504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:14:15.535203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:15.535931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:15.542800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:15.543249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:15.544003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:15.544462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:15.604405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:15.612335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b00fa615-87c6-4487-bdb4-d54f4d2181ca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081800 Jul 20 14:14:15.612889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1276/2753] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:16.628285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:16.628880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:16.635451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:16.636395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:16.636668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:16.637095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:16.743074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:16.751690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-79d741a3-b724-4327-924f-097b3bf8859a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.127219 Jul 20 14:14:16.752265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1478/2754] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:17.768425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:17.769039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:17.775424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:17.775876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:17.776664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:17.777102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:17.880214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:17.888072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-79483884-5ecd-4acf-a553-b700b9ac09b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.124039 Jul 20 14:14:17.888600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1277/2755] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:17 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:18.904942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:18.905541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:18.911911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:18.912382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:18.913127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:18.913554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:18.974614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:18.982517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ae876080-4ddb-4d14-a138-665dc713db7f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081611 Jul 20 14:14:18.983072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1479/2756] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:18 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:20.000861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:20.001414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:20.007827 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:20.008310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:20.009068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:20.009501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:20.072625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:20.080522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9b4a75f9-3680-44fd-808c-7e6124142fc2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084244 Jul 20 14:14:20.081079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1278/2757] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:21.098062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:21.098650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:21.100942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=28 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:21.106579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:21.107065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:21.107977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:21.108500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:21.112829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=82 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:21.172351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:21.180085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4b9dde17-a5b2-4167-8aa3-22a1c057ccc5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086547 Jul 20 14:14:21.180665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1480/2758] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:22.196558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:22.197206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:22.204254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:22.204702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:22.205455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:22.205886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:22.267710 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:22.275486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d2f4cba3-1120-4379-b39a-d941a0eafa0d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082896 Jul 20 14:14:22.276042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1279/2759] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:23.292873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:23.293468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:23.300442 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:23.300886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:23.301639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:23.302067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:23.362401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:23.370058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-38599a50-5488-42d1-8971-1b567f40e022 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080978 Jul 20 14:14:23.370604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1481/2760] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:24.386594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:24.387285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:24.389561 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=28 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:24.395822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:24.396288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:24.397045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:24.397493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:24.457514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:24.465559 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-57a7cc0a-7adc-4659-94e4-a72913facca1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082884 Jul 20 14:14:24.466106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1280/2761] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:24 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:25.482184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:25.482794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:25.489873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:25.490325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:25.491083 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:25.491518 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:25.551861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:25.559712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2487db0d-0f24-4643-9558-0e431a5a2792 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081450 Jul 20 14:14:25.560292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1482/2762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:26.577174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:26.578518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:26.585092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:26.585791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:26.586550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:26.586982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:26.647727 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:26.655634 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9eeb3716-463d-4582-b6ad-5d717e1b3897 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082338 Jul 20 14:14:26.656203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1281/2763] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:27.672411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:27.673012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:27.679609 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:27.680059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:27.680851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:27.681287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:27.741333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:27.749030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-55e746fd-d948-48f7-a684-6ead8b7d042e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080599 Jul 20 14:14:27.749591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1483/2764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:28.765624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:28.766238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:28.772443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:28.772892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:28.773652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:28.774085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:28.836767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:28.845090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-34f87f25-5b70-4e25-b3c6-de9595afb165 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083444 Jul 20 14:14:28.845648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1282/2765] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:28 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:29.862501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:29.863111 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:29.869653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:29.870105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:29.870869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:29.871302 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:29.936005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:29.944496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-da432204-b5fb-40fd-8089-7f44d535788e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086301 Jul 20 14:14:29.945049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1484/2766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:30.961138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:30.961746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:30.968761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:30.969197 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:30.969953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:30.970387 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:31.032766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:31.040564 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e3dcf2ab-45c4-47c6-871a-349f8997eab0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083551 Jul 20 14:14:31.041116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1283/2767] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:32.057656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:32.058240 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:32.065278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:32.065720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:32.066463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:32.066892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:32.126623 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:32.134400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3e2901c8-8f7a-4e8b-9d03-0b3d5635b754 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080613 Jul 20 14:14:32.134952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1485/2768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:33.150932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:33.151536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:33.157930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:33.158369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:33.159110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:33.159536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:33.219098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:33.226816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-da0720ce-e0a3-4f42-bc50-e22be54baa04 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079729 Jul 20 14:14:33.227367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1284/2769] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:14:34.243365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:34.243972 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:34.250445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:34.250892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:34.251658 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:34.252088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:34.313084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:34.320896 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c83140f1-f637-4200-9892-fe6a093e774d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081409 Jul 20 14:14:34.321406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1486/2770] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:35.337900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:35.338502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:35.345536 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:35.345975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:35.346719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:35.347148 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:35.407306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:35.415078 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fcad060e-ba78-4885-be27-a7a6d69de9d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081275 Jul 20 14:14:35.415639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1285/2771] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:36.431669 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:36.432364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:36.439262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:36.439692 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:36.440471 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:36.440907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:36.501430 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:36.511888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1c2effa3-7544-40af-8720-3a06023438b1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083754 Jul 20 14:14:36.512949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1487/2772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:37.528980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:37.529514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:37.536626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:37.537069 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:37.537847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:37.538273 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:37.604030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:37.611897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4b0a8892-146b-4ca2-a961-29deba92ea82 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086873 Jul 20 14:14:37.612488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1286/2773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:38.629130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:38.629720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:38.637631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:38.638089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:38.638862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:38.639298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:38.706841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:38.714960 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8187b9a4-61ff-43ca-83ba-d4d0d9a5f581 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.090361 Jul 20 14:14:38.715520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1488/2774] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:38 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:39.730572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:39.731182 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:39.737757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:39.738205 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:39.738964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:39.739397 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:39.798946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:39.806680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bcc38ac5-60c7-4073-b9d0-31076253c9e7 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080009 Jul 20 14:14:39.807233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1287/2775] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:40.824036 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:40.824695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:40.831462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:40.831912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:40.832701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:40.833138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:40.893152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:40.900975 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f6bd56c4-8207-4d63-8451-a2eab579779b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080875 Jul 20 14:14:40.901541 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1489/2776] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:41.918632 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:41.921195 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:41.926057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:41.926509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:41.927270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:41.927740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:41.931648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=84 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:41.989183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:41.997024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e82bd005-7eef-4f0c-95b9-1c1b5befe3c0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082269 Jul 20 14:14:41.997580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1288/2777] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:43.013441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:43.014051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:43.021567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:43.022018 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:43.022787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:43.023221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:43.093428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:43.101739 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0e08a6be-38b2-4eac-8b25-bf21c4ea47e5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.092229 Jul 20 14:14:43.102304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1490/2778] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:43 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:44.118997 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:44.119596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:44.126830 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:44.127275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:44.128048 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:44.128522 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:44.187573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:44.195979 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61946a8a-9827-4a88-b7b6-deddfc9b5450 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080858 Jul 20 14:14:44.196572 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1289/2779] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:44 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:45.212996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:45.213586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:45.220051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:45.220529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:45.221284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:45.221717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:45.281075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:45.288863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-93f6c3d4-bc38-4e1f-9142-ac2dd791172f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.079970 Jul 20 14:14:45.289416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1491/2780] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:45 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:46.305338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:46.305952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:46.312365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:46.312805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:46.314159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:46.314579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:46.376528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:46.384251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5b680ab1-9695-477b-82dd-971593be2d67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082713 Jul 20 14:14:46.384803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1290/2781] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:46 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:47.401146 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:47.401757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:47.407919 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:47.408406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:47.409184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:47.409624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:47.473021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:47.480979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d1eac699-7c71-4485-95db-d3662b3affdf tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083851 Jul 20 14:14:47.481537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1492/2782] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:47 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:48.498135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:48.498746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:48.506054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:48.506497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:48.507255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:48.507685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:48.569494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:48.580455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9aaf5c4a-3272-4744-9dc1-f6d7b1ee6c3c tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086021 Jul 20 14:14:48.581198 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1291/2783] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:48 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:49.596850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:49.597528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:49.603957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:49.604448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:49.605205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:49.605635 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:49.665708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:49.673531 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-37e62833-ef97-4370-8ac5-3f554093ba80 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080575 Jul 20 14:14:49.674089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1493/2784] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:49 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:50.690606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:50.691208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:50.697638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:50.698088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:50.698851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:50.699288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:50.759022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:50.766897 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d9d87103-5e0f-48ca-99f1-f7271f7f8242 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080750 Jul 20 14:14:50.767491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1292/2785] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:50 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:51.782909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:51.783508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:51.785776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=28 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:51.790930 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:51.791372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:51.792117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:51.792565 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:51.795167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=84 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:51.853321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:51.860954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e097e582-8bb6-47d3-b03f-e75f823ce4d6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081944 Jul 20 14:14:51.861505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1494/2786] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:51 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:52.877529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:52.878045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:52.884443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:52.884908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:52.885648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:52.886077 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:52.947302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:52.955199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ada503cc-68e9-44a4-a42e-876f40933789 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081601 Jul 20 14:14:52.956295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1293/2787] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:52 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:53.972439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:53.973052 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:53.979470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:53.979920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:53.980708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:53.981148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:54.041171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:54.048958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-893875d7-0d9a-485b-99c8-d02bf79d9a7e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080410 Jul 20 14:14:54.050070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1495/2788] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:53 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:55.066649 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:55.067328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:55.069558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=28 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:55.074942 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:55.075382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:55.076130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:55.076580 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:55.140217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:55.148185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6459f573-983b-4fb0-a0cc-290338a6f1f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085876 Jul 20 14:14:55.148770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1294/2789] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:55 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:56.165417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:56.166019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:56.172459 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:56.172899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:56.173643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:56.174075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:56.237171 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:56.245157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e1a00599-d7d6-4249-a503-848e1f372a33 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083560 Jul 20 14:14:56.245721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1496/2790] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:56 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:57.262009 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:57.262615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:57.269604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:57.270052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:57.270807 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:57.271232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:57.330060 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:57.338617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fc766d15-cb9a-407b-a165-f6f3ebe4ee88 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080449 Jul 20 14:14:57.339165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1295/2791] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:57 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:58.354840 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:58.355475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:58.361925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:58.362372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:58.363137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:58.363571 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:58.426057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:58.433867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2d991617-69ed-4475-b961-7fb35045a186 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082900 Jul 20 14:14:58.434436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1497/2792] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:58 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:14:59.450605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:14:59.451200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:14:59.458109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:59.458550 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:59.459295 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:14:59.459720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:14:59.525753 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:14:59.533597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-772311a1-2c76-4745-93c0-e8a19ea1b6a8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.086946 Jul 20 14:14:59.534145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1296/2793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:14:59 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:00.550780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:00.551407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:00.557903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:00.558362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:00.559124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:00.559562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:00.620114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:00.628038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-53649581-4cf9-465f-bdfe-7edd79ca7dfd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081145 Jul 20 14:15:00.628723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1498/2794] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:00 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:01.644819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:01.645431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:01.652093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:01.652615 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:01.653320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:01.653749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:01.714797 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:01.723062 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-274c9f91-00a5-42a5-949d-e730188decc4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081662 Jul 20 14:15:01.723629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1297/2795] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:01 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:02.740090 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:02.740725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:02.747328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:02.747776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:02.748686 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:02.749011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:02.809460 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:02.818127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e28e6e25-bbe6-483b-9d24-c3aab48bcd32 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082392 Jul 20 14:15:02.818688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1499/2796] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:02 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:03.835668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:03.836301 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:03.842966 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:03.843427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:03.844185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:03.844643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:03.906761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:03.914597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7415e37a-a945-4eb0-98ec-074a6edbd96b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083735 Jul 20 14:15:03.915157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1298/2797] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:03 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:04.931222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:04.931832 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:04.941341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:04.941789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:04.942548 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:04.942980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:05.007112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:05.015031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9952e57d-c359-46a0-a721-38eaccffd819 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087687 Jul 20 14:15:05.015597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1500/2798] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:04 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:06.032212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:06.032840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:06.039877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:06.040362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:06.041123 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:06.041556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:06.102066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:06.109927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-39fe7875-6c0d-44ce-81c2-59fbdb143e46 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081557 Jul 20 14:15:06.110485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1299/2799] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:06 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:07.127221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:07.133911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:07.136963 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:07.137416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:07.138193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:07.138633 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:07.199764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:07.207619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aa70312c-d564-4379-b4c9-595a5e15c3e0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.084535 Jul 20 14:15:07.208184 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1501/2800] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:07 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:08.224758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:08.225394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:08.231880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:08.232364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:08.233129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:08.233565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:08.294350 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:08.302192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b6db3dfc-1e6a-4421-a34e-cd89cc5851d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081408 Jul 20 14:15:08.302748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1300/2801] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:08 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:09.319219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:09.319818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:09.326350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:09.326798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:09.327554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:09.327984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:09.389175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:09.396886 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5bf77862-ea8f-4686-8e73-4ef94f971e02 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081974 Jul 20 14:15:09.397441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1502/2802] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:09 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:10.413684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:10.414276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:10.420881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:10.421275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:10.422025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:10.422453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:10.482800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:10.491249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d29967b3-196c-4522-80e9-807e3e090857 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081419 Jul 20 14:15:10.491799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1301/2803] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:10 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:11.507019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:11.507626 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:11.514501 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:11.514952 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:11.515713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:11.516150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:11.576167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:11.584468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7392a4b4-49dc-4585-82b1-e15422b961d8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081386 Jul 20 14:15:11.585030 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1503/2804] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:11 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:12.601976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:12.602687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:12.610325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:12.611144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:12.612228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:12.613556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:12.617511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=84 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:12.677526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:12.685292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-11328a65-bf0e-4df2-b82e-8c31901ce88d tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087761 Jul 20 14:15:12.685843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1302/2805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:12 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:13.702536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:13.703134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:13.709483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:13.709925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:13.710925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:13.711350 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:13.776158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:13.784470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bd2ae7db-947e-4146-9dab-41f532931c49 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.085715 Jul 20 14:15:13.785529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1504/2806] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:13 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:14.802140 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:14.802748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:14.809272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:14.809722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:14.810479 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:14.810917 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:14.871045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:14.879622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-84559f04-1641-4417-95e4-2dfd10b833f3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081325 Jul 20 14:15:14.880208 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1303/2807] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:14 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:15.896032 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:15.896670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:15.903110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:15.903562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:15.904356 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:15.904791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:15.965483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:15.974187 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7043ad35-16b9-4cd5-b001-11dcf478b6d0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081939 Jul 20 14:15:15.974760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1505/2808] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:15 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:16.991786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:16.992428 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:16.999214 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:16.999659 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:17.000452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:17.000886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:17.061264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:17.068903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0300b89e-2476-469e-8d8f-f5a4c377ffd5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080966 Jul 20 14:15:17.069460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1304/2809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:16 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:18.085898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:18.086499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:18.092494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:18.092935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:18.093677 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:18.094103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:18.153329 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:18.162515 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-edf941fd-bc17-484f-b67e-d382c1d37cca tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080404 Jul 20 14:15:18.162747 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1506/2810] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:18 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:19.178886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:19.179494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:19.185983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:19.186421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:19.187179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:19.187608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:19.247819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:19.255725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-01d1fc00-8b01-4bf5-919a-4d8f91ead0cd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080734 Jul 20 14:15:19.256296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1305/2811] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:19 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:20.272470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:20.273118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:20.279553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:20.280003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:20.282168 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:20.282615 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:20.342822 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:20.351150 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f57b316e-6382-46c2-9948-5530d20533f8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082633 Jul 20 14:15:20.351717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1507/2812] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:20 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:21.367666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:21.368300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:21.375013 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:21.375462 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:21.376250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:21.376691 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:21.442811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:21.451105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-efb9089d-ef47-4af0-82b9-6d194d27a3a0 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.087303 Jul 20 14:15:21.451675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1306/2813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:21 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:21.889332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-b1a864db-b9d2-4539-acb6-988743a86762 req-4b8a5ae3-723b-437d-8eb3-ca8fe7795d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b88a32-fbda-4e26-9d53-d40d22586cba", "name": "network-vif-deleted", "tag": "119533a5-579b-497a-b65d-fcd7a8d39cd6"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:15:21.892705 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=28 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:21.898987 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-b1a864db-b9d2-4539-acb6-988743a86762 req-4b8a5ae3-723b-437d-8eb3-ca8fe7795d69 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:21.899423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-b1a864db-b9d2-4539-acb6-988743a86762 req-4b8a5ae3-723b-437d-8eb3-ca8fe7795d69 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:21.903070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=84 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:21.912048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-b1a864db-b9d2-4539-acb6-988743a86762 req-4b8a5ae3-723b-437d-8eb3-ca8fe7795d69 service nova] Creating event network-vif-deleted:119533a5-579b-497a-b65d-fcd7a8d39cd6 for instance 91b88a32-fbda-4e26-9d53-d40d22586cba on hv-cinder-81914 Jul 20 14:15:21.916948 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-b1a864db-b9d2-4539-acb6-988743a86762 req-4b8a5ae3-723b-437d-8eb3-ca8fe7795d69 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135617 Jul 20 14:15:21.917704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1508/2814] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:15:22.468780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:22.469386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:22.476438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:22.476887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:22.477641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:22.478073 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:22.546655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:22.555142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e04ffd47-1513-4279-b82e-1bc883ed5655 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.090318 Jul 20 14:15:22.555700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1307/2815] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:22 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:23.572367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:23.573084 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:23.579250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:23.579691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:23.580462 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:23.580887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:23.648042 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:23.656005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-db838f3d-87a6-4e40-a44d-e560a12f90d3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.088762 Jul 20 14:15:23.656605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1509/2816] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:23 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:24.673237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:24.673835 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:24.680786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:24.681227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:24.681970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:24.682398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:24.743375 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:24.751250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b8bffcd5-6029-4d6f-816f-9595bc051a36 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081863 Jul 20 14:15:24.751834 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1308/2817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:24 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:15:25.767435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:25.768048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:25.774523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:25.775001 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:25.775765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:25.776215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:25.839300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:25.847140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17a0cda3-297f-4c51-957a-f4071c6c13fd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083630 Jul 20 14:15:25.848480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1510/2818] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:25 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:25.888358 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:15:25.888821 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:15:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:15:26.865119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:26.865733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:26.868047 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=30 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:26.873443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:26.873893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:26.874651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:26.875081 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:26.934680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:26.943181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f1ba895f-795c-478d-96c7-aaf778d271ed tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082503 Jul 20 14:15:26.943735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1309/2819] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:26 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:27.959763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:27.960661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:27.967185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:27.967629 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:27.968420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:27.968856 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:28.030773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:28.039105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f677c3b2-14da-4c86-87cb-0d4f657364f6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083164 Jul 20 14:15:28.039659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1511/2820] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:27 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:29.056157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:29.057480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:29.063327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:29.063799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:29.064604 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:29.065043 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:29.127430 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:29.135909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c8db36fe-9d31-401b-a2a9-18efacf325b4 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083615 Jul 20 14:15:29.136503 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1310/2821] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:29 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:30.151950 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:30.152573 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:30.159010 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:30.159452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:30.160724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:30.161155 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:30.374587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:30.381942 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d45bbced-907e-421e-bfb2-563b36833893 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.233832 Jul 20 14:15:30.382491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1512/2822] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:30 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:31.397791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:31.398402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:31.405092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:31.405545 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:31.406317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:31.406755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:31.469086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:31.477890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-61dfa783-4596-45bf-9b7f-d8172db4eec1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083908 Jul 20 14:15:31.478502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1311/2823] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:31 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:32.494370 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:32.495011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:32.501475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:32.501928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:32.502688 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:32.503128 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:32.563863 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:32.572386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0069b655-66f5-4a9c-9c95-e276ffa84d4a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081853 Jul 20 14:15:32.572937 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1513/2824] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:32 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:33.589220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:33.589220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:33.596146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:33.596624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:33.597441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:33.597874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:33.658553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:33.667261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-83a73501-693f-4ee1-a602-997b802a007f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082405 Jul 20 14:15:33.667837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1312/2825] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:33 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:33.800135 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:15:33.800785 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:15:34.683837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:34.684464 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:34.690862 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:34.691309 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:34.692058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:34.692519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:34.755212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:34.762981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-19110209-b0ed-410b-9a78-3e1feaf44e40 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083040 Jul 20 14:15:34.763525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1514/2826] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:34 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:35.778760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:35.779365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:35.785801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:35.786238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:35.787008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:35.787433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:35.849994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:35.857776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0d7cc526-2aa3-45cd-9649-2395a0bbeead tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082843 Jul 20 14:15:35.858328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1313/2827] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:35 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:36.014034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:15:36.014221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:15:36.874997 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:36.875632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:36.882527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:36.882976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:36.883731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:36.884160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:36.944118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:36.951811 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-23ff31e6-10c0-4d86-8943-1e7e690f08f2 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080766 Jul 20 14:15:36.952406 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1515/2828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:36 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:37.970075 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:37.970680 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:37.977646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:37.978087 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:37.978842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:37.979270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:38.041590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:38.049426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-38f3d2e9-d223-4e09-be51-887ac51af191 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.083224 Jul 20 14:15:38.049972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1314/2829] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:37 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:39.065933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:39.066539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:39.072985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:39.073427 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:39.074170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:39.074604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:39.134650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:39.142559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-261d9973-ceed-4036-b72b-ee08659273b3 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080516 Jul 20 14:15:39.143114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1516/2830] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:39 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:40.159255 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:40.160548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:40.166976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:40.167422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:40.168173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:40.168623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:40.228548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:40.236416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-37fbada4-7854-4ad4-860e-ce822e9fe405 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.081050 Jul 20 14:15:40.236972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1315/2831] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:40 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:15:41.253835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:41.254509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:41.260976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:41.261417 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:41.262172 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:41.262605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:41.322675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:41.330435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9fa788d7-3cf6-4824-953a-c3f00407cf8b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.080987 Jul 20 14:15:41.330986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1517/2832] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:41 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:42.355411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:42.355411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:42.356056 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:42.356280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:42.357186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:42.357630 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:42.418663 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:42.426590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-81c1a98b-5749-43a6-8ef1-278d4b3271d5 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 200 len: 1368 microversion: 2.1 time: 0.082660 Jul 20 14:15:42.427153 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1316/2833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:42.443663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b28f5c91-f5b2-4ba0-9889-735d23af7330 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '.version_select at 0x7fa40d1129d0>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:42.465236 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b28f5c91-f5b2-4ba0-9889-735d23af7330 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830455995" status: 202 len: 0 microversion: 2.1 time: 0.025625 Jul 20 14:15:42.469652 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1518/2834] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 14:15:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830455995 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:15:43.226678 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-aa02cb02-bd8a-441d-b4b8-170096e65872 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'create', calling method: .version_select at 0x7fa40d2c0d30>, body: {"keypair": {"name": "tempest-keypair-1523320086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwauLFDQe+pbl+239YyhiEKSYqWCFNrdLooqY8etXD+69JTd7OpfXuAVldiZ6N/LayY4/9ni4IJVsH/86uL8oHeKvpUj8fEX8WYm5h899EZpjNjF59cRpXEaMXmB84WyQ=="}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:15:43.242506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-aa02cb02-bd8a-441d-b4b8-170096e65872 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:15:43.246456 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-aa02cb02-bd8a-441d-b4b8-170096e65872 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for user b55c81544d4342fb89dd8dbce3400fe4 and project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:15:43.271813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-aa02cb02-bd8a-441d-b4b8-170096e65872 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049034 Jul 20 14:15:43.272431 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1317/2835] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 14:15:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:15:44.482643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-76165895", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd6608b4-5bdb-4caf-9118-f60455994f25"}], "security_groups": [{"name": "tempest-securitygroup--1922068926"}], "key_name": "tempest-keypair-1523320086", "user_data": "}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:15:44.587916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] validate_networks() for [('cd6608b4-5bdb-4caf-9118-f60455994f25', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:15:45.260979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:15:45.261443 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:15:45.261939 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:15:45.262347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:15:45.262759 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:15:45.272415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:45.272857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:45.273636 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:45.274067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:45.290287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:15:45.294133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Getting quotas for user b55c81544d4342fb89dd8dbce3400fe4 and project ef1e44c6f9fc41ffaf49a0fec012031b. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:15:45.305258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:15:45.307458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:15:45.352773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-98ebf5e9-ece8-4462-8224-63dbf758a35e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.875049 Jul 20 14:15:45.353600 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1519/2836] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:15:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:15:45.364445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7521f4c8-4e5a-4c7b-b9d8-f8d4f8212e67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:45.365053 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7521f4c8-4e5a-4c7b-b9d8-f8d4f8212e67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:45.430021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7521f4c8-4e5a-4c7b-b9d8-f8d4f8212e67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:45.447052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7521f4c8-4e5a-4c7b-b9d8-f8d4f8212e67 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1236 microversion: 2.1 time: 0.087340 Jul 20 14:15:45.447611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1318/2837] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:45 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:46.463949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:46.464590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:46.471364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:46.471749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:46.472545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:46.472979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:46.547711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:46.555112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2220f08f-e4b2-425e-b5c5-9fd5cee8751f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1294 microversion: 2.1 time: 0.095772 Jul 20 14:15:46.555675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1520/2838] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:46 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:47.571465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:47.572805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:47.579421 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:47.579871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:47.580717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:47.581721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:47.586088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=90 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:47.677009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-1790c7bf-64f0-41ae-a016-6c4fbeabb555 req-15997e1d-9bc2-409e-bbc9-e81b3f186b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360fd7f3-5507-4b5e-8370-3ac351f06437", "tag": "63b21216-6fdd-4e68-9665-a785ee256f0d"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:15:47.695680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-1790c7bf-64f0-41ae-a016-6c4fbeabb555 req-15997e1d-9bc2-409e-bbc9-e81b3f186b6a service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:47.696320 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-1790c7bf-64f0-41ae-a016-6c4fbeabb555 req-15997e1d-9bc2-409e-bbc9-e81b3f186b6a service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:47.711249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-1790c7bf-64f0-41ae-a016-6c4fbeabb555 req-15997e1d-9bc2-409e-bbc9-e81b3f186b6a service nova] Creating event network-changed:63b21216-6fdd-4e68-9665-a785ee256f0d for instance 360fd7f3-5507-4b5e-8370-3ac351f06437 on hv-cinder-81914 Jul 20 14:15:47.717980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-1790c7bf-64f0-41ae-a016-6c4fbeabb555 req-15997e1d-9bc2-409e-bbc9-e81b3f186b6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049741 Jul 20 14:15:47.719147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1521/2839] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:15:47.740810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:47.749145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6a9eb3be-a9a9-4e5d-888b-e8561d855114 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1362 microversion: 2.1 time: 0.181967 Jul 20 14:15:47.757127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1319/2840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:47 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:48.766372 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:48.767064 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:48.773744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:48.774191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:48.774949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:48.775380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:48.914924 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:48.922231 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c178c369-0919-44ef-be04-7d96463a7c3b tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1362 microversion: 2.1 time: 0.160169 Jul 20 14:15:48.922825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1522/2841] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:48 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:49.938861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:49.939509 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:49.946116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:49.946597 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:49.947355 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:49.947786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:50.073068 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:50.080292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bda1b121-a466-4aab-a889-675864548164 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1362 microversion: 2.1 time: 0.145220 Jul 20 14:15:50.080857 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1320/2842] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:49 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:51.097721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:51.098299 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:51.104761 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:51.105229 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:51.105976 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:51.106414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:51.235717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:51.243712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ca963f46-600f-4db0-885b-d43c5e8fdc2a tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1362 microversion: 2.1 time: 0.150028 Jul 20 14:15:51.244305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1523/2843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:51 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:52.260393 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:52.261079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:52.264985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:52.265144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-d40d820e-844c-48a2-b486-64493df002e8 req-fb8f2a49-19dd-4a7a-ba50-4079d8935825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360fd7f3-5507-4b5e-8370-3ac351f06437", "name": "network-vif-plugged", "status": "completed", "tag": "63b21216-6fdd-4e68-9665-a785ee256f0d"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:15:52.271412 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:52.271910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:52.272859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:52.273536 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:52.274052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-d40d820e-844c-48a2-b486-64493df002e8 req-fb8f2a49-19dd-4a7a-ba50-4079d8935825 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:52.274493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-d40d820e-844c-48a2-b486-64493df002e8 req-fb8f2a49-19dd-4a7a-ba50-4079d8935825 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:52.279332 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=78 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:52.289131 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-d40d820e-844c-48a2-b486-64493df002e8 req-fb8f2a49-19dd-4a7a-ba50-4079d8935825 service nova] Creating event network-vif-plugged:63b21216-6fdd-4e68-9665-a785ee256f0d for instance 360fd7f3-5507-4b5e-8370-3ac351f06437 on hv-cinder-81914 Jul 20 14:15:52.294924 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-d40d820e-844c-48a2-b486-64493df002e8 req-fb8f2a49-19dd-4a7a-ba50-4079d8935825 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086537 Jul 20 14:15:52.295512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1321/2844] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:15:52.413824 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:52.421214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-adbcd191-9d2a-4788-98fe-70cb41d389c1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1362 microversion: 2.1 time: 0.164981 Jul 20 14:15:52.421770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1524/2845] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:52 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:15:53.439169 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:53.439850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:53.446666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:53.447119 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:53.447843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:53.448302 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:53.579192 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:53.586719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0b4ac9a3-32c2-48b0-b30e-a7b4bca457c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1362 microversion: 2.1 time: 0.152493 Jul 20 14:15:53.587267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1322/2846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:53 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:54.603903 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:54.604599 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:54.611055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:54.611502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:54.612286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:54.612724 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:54.746582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:15:54.754106 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bbec6021-aefa-41ac-8a6f-e59075d8e601 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1549 microversion: 2.1 time: 0.154071 Jul 20 14:15:54.754664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1525/2847] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:15:54 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:15:54.770105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d757c3bb-9b87-497e-aae1-791057720dcd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:15:54.770628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d757c3bb-9b87-497e-aae1-791057720dcd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:15:54.777111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d757c3bb-9b87-497e-aae1-791057720dcd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:54.777563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d757c3bb-9b87-497e-aae1-791057720dcd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:54.778325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d757c3bb-9b87-497e-aae1-791057720dcd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:54.778760 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d757c3bb-9b87-497e-aae1-791057720dcd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:54.858425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d757c3bb-9b87-497e-aae1-791057720dcd tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092139 Jul 20 14:15:54.859031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1323/2848] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 14:15:54 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:15:55.758140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:55.758881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=6 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:55.808764 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-7092b069-28f0-4f33-a768-8e03ca001325 req-4afa5d6d-87d7-44f5-bfb0-38948f7e56a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360fd7f3-5507-4b5e-8370-3ac351f06437", "tag": "63b21216-6fdd-4e68-9665-a785ee256f0d"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:15:55.817259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-7092b069-28f0-4f33-a768-8e03ca001325 req-4afa5d6d-87d7-44f5-bfb0-38948f7e56a7 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:15:55.817697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-7092b069-28f0-4f33-a768-8e03ca001325 req-4afa5d6d-87d7-44f5-bfb0-38948f7e56a7 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:15:55.830235 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-7092b069-28f0-4f33-a768-8e03ca001325 req-4afa5d6d-87d7-44f5-bfb0-38948f7e56a7 service nova] Creating event network-changed:63b21216-6fdd-4e68-9665-a785ee256f0d for instance 360fd7f3-5507-4b5e-8370-3ac351f06437 on hv-cinder-81914 Jul 20 14:15:55.835491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-7092b069-28f0-4f33-a768-8e03ca001325 req-4afa5d6d-87d7-44f5-bfb0-38948f7e56a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081892 Jul 20 14:15:55.836292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1526/2849] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:16:32.070203 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:16:32.071641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:16:32.072293 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=23 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:16:32.076104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d9a269ef-bfb3-4b1b-b98b-ebf2d943fba8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:16:32.076619 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d9a269ef-bfb3-4b1b-b98b-ebf2d943fba8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:16:32.084725 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9a269ef-bfb3-4b1b-b98b-ebf2d943fba8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:16:32.085455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9a269ef-bfb3-4b1b-b98b-ebf2d943fba8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:16:32.086218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9a269ef-bfb3-4b1b-b98b-ebf2d943fba8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:16:32.086658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d9a269ef-bfb3-4b1b-b98b-ebf2d943fba8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:16:32.109895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d9a269ef-bfb3-4b1b-b98b-ebf2d943fba8 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437/ips" status: 200 len: 146 microversion: 2.1 time: 0.040609 Jul 20 14:16:32.110454 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1324/2850] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 14:16:32 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:17:32.183049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ac2ab14-2cb1-4e9a-abe3-c93e03dce4a6] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 14:17:32.183639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=5 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:17:32.184400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=13 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:17:32.188837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:32.189420 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:17:32.196971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:32.197423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:32.198183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:32.198621 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:32.222509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:17:32.295334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2340fcda-ca13-4db7-89e5-3c530401c5d1 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 204 len: 0 microversion: 2.1 time: 0.113892 Jul 20 14:17:32.296254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1527/2851] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:17:32 2022] DELETE /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 14:17:32.304057 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:17:32.304887 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=4 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:17:32.309126 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:32.309993 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:17:32.316602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:32.317037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:32.317779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:32.318861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:32.447419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:17:32.454694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-130779f0-0c9c-4472-92d0-d6cd6f0c6b13 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1673 microversion: 2.1 time: 0.154359 Jul 20 14:17:32.455241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1325/2852] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:17:32 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:17:33.473539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:33.474735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:17:33.486846 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:33.487296 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:33.488101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:33.488588 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:33.492821 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ac2ab14-2cb1-4e9a-abe3-c93e03dce4a6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60678. Jul 20 14:17:33.636537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:17:33.644116 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-024d9f4a-7db9-4fa9-a5c3-ccd00d803a1e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1673 microversion: 2.1 time: 0.174855 Jul 20 14:17:33.649055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1528/2853] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:17:33 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:17:34.662485 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:34.663023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:17:34.669881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:34.670328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:34.671100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:34.671534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:34.778502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55c81544d4342fb89dd8dbce3400fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:17:34.792271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1fc051d6-c3c6-4ce3-842d-1ab18e0380c6 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 200 len: 1605 microversion: 2.1 time: 0.134199 Jul 20 14:17:34.793099 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1326/2854] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:17:34 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 1605 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:17:34.835414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-5ca8f39f-17a9-4afb-834d-87db1a3aa715 req-ab87dcad-b486-4e0a-8cc6-9182e5264347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360fd7f3-5507-4b5e-8370-3ac351f06437", "name": "network-vif-deleted", "tag": "63b21216-6fdd-4e68-9665-a785ee256f0d"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:17:34.845087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-5ca8f39f-17a9-4afb-834d-87db1a3aa715 req-ab87dcad-b486-4e0a-8cc6-9182e5264347 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:34.845538 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-5ca8f39f-17a9-4afb-834d-87db1a3aa715 req-ab87dcad-b486-4e0a-8cc6-9182e5264347 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:34.858701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-5ca8f39f-17a9-4afb-834d-87db1a3aa715 req-ab87dcad-b486-4e0a-8cc6-9182e5264347 service nova] Creating event network-vif-deleted:63b21216-6fdd-4e68-9665-a785ee256f0d for instance 360fd7f3-5507-4b5e-8370-3ac351f06437 on hv-cinder-81914 Jul 20 14:17:34.863889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-5ca8f39f-17a9-4afb-834d-87db1a3aa715 req-ab87dcad-b486-4e0a-8cc6-9182e5264347 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032435 Jul 20 14:17:34.864553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1529/2855] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:17:35.809238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:35.809851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:17:35.816523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:35.816976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:35.817738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:35.818906 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:35.831953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] HTTP exception thrown: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Request method failure captured: Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 HTTP/1.1 Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdZmG8C_MCYYPXW2PKEaP4c-42tMbL9nzyX5KaFXJe2MrWRqfjgA_519xXHpt-sJBxg5XL3ZNmkCI2v577e190BWv9HrC9QNWgt1a5Cpi7pUuNsxa5PaCbAI-s3lzoyQP16b68WgPE1QAD4ZODxJT2g6LSdKI5qmcnZwjsR_UNXvEM Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:17:35.833616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}] Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: b55c81544d4342fb89dd8dbce3400fe4 Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:35.836010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '360fd7f3-5507-4b5e-8370-3ac351f06437'} Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:17:35.837015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:35.838636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:35.839995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Returning 404 to user: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:17:35.839995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b27706b3-0071-4d3e-b8b6-8dc5c0170c26 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 404 len: 111 microversion: 2.1 time: 0.029541 Jul 20 14:17:35.839995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1327/2856] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:17:35 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:17:35.845364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c3fa737b-9c4b-4c94-829f-54c180721f64 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '.version_select at 0x7fa40d0e8430>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:35.862901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c3fa737b-9c4b-4c94-829f-54c180721f64 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523320086" status: 202 len: 0 microversion: 2.1 time: 0.022125 Jul 20 14:17:35.863467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1530/2857] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 14:17:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523320086 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:17:36.481220 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:36.481831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:17:36.487808 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:36.488284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:36.489040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:36.489472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:36.503198 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] HTTP exception thrown: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Request method failure captured: Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: DELETE /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 HTTP/1.1 Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdZmG8C_MCYYPXW2PKEaP4c-42tMbL9nzyX5KaFXJe2MrWRqfjgA_519xXHpt-sJBxg5XL3ZNmkCI2v577e190BWv9HrC9QNWgt1a5Cpi7pUuNsxa5PaCbAI-s3lzoyQP16b68WgPE1QAD4ZODxJT2g6LSdKI5qmcnZwjsR_UNXvEM Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:17:36.504745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}] Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: b55c81544d4342fb89dd8dbce3400fe4 Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.506398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '360fd7f3-5507-4b5e-8370-3ac351f06437'} Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:17:36.510116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.511608 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.513206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Returning 404 to user: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:17:36.513206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d1a1e1a3-48f9-4903-8d8c-937dd7723c6e tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 404 len: 111 microversion: 2.1 time: 0.028734 Jul 20 14:17:36.513206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1328/2858] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:17:36 2022] DELETE /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:17:36.514384 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:17:36.515101 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 360fd7f3-5507-4b5e-8370-3ac351f06437] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:17:36.521610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:36.522051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:36.522798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:17:36.523258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:17:36.535921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] HTTP exception thrown: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Request method failure captured: Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 HTTP/1.1 Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdZmG8C_MCYYPXW2PKEaP4c-42tMbL9nzyX5KaFXJe2MrWRqfjgA_519xXHpt-sJBxg5XL3ZNmkCI2v577e190BWv9HrC9QNWgt1a5Cpi7pUuNsxa5PaCbAI-s3lzoyQP16b68WgPE1QAD4ZODxJT2g6LSdKI5qmcnZwjsR_UNXvEM Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:17:36.538037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}] Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: b55c81544d4342fb89dd8dbce3400fe4 Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.539717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '360fd7f3-5507-4b5e-8370-3ac351f06437'} Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:17:36.540828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. Jul 20 14:17:36.542338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:17:36.543676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Returning 404 to user: Instance 360fd7f3-5507-4b5e-8370-3ac351f06437 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:17:36.543676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-81bfa400-e673-43a7-ab4d-f0463100ef23 tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437" status: 404 len: 111 microversion: 2.1 time: 0.028869 Jul 20 14:17:36.543676 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1531/2859] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:17:36 2022] GET /compute/v2.1/servers/360fd7f3-5507-4b5e-8370-3ac351f06437 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:18:45.896611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:18:45.897238 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:18:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:18:53.809057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:18:53.809648 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:18:56.022143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:18:56.022672 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:18:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:20:34.313120 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:20:34.313859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:20:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:20:53.867149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:20:53.867801 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:20:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:20:54.727335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:20:54.727839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:21:40.829844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1da21261-6da5-4cc1-b35f-e2e1a7235725] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 14:21:40.830534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=8 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:40.831568 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=16 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:40.836524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:40.837029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:40.844675 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:40.845117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:40.846082 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:40.846528 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:40.872298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Going to try to terminate instance {{(pid=129542) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:21:40.925464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.compute.api [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Instance is already in deleting state, ignoring this request Jul 20 14:21:40.926286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-157aad43-c249-443d-8a58-ced9337fe973 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 204 len: 0 microversion: 2.20 time: 0.098485 Jul 20 14:21:40.926912 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1329/2860] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jul 20 14:21:40 2022] DELETE /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 14:21:40.938398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:40.939005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:40.942601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ac2ab14-2cb1-4e9a-abe3-c93e03dce4a6] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 14:21:40.943138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:40.943779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:40.951034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:40.951562 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:40.952288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:40.953011 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:41.167486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:41.176276 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:41.177852 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9cb52fe271348c1bc0ffda92063bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6c042204f0471ba5c2f8a67604a802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:41.179070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ee537031-9a86-4ef1-b968-3d3ff8fcb264 tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 200 len: 1443 microversion: 2.20 time: 0.245533 Jul 20 14:21:41.179618 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1532/2861] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:21:40 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 1443 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 14:21:41.972219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:41.972735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:41.980646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:41.981346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:41.982461 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:41.985711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.005438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] [1da21261-6da5-4cc1-b35f-e2e1a7235725] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60826. Jul 20 14:21:42.016734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Going to try to terminate instance {{(pid=129542) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:21:42.024841 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:42.025426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:42.034920 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.035452 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.036337 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.037505 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.043517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ac2ab14-2cb1-4e9a-abe3-c93e03dce4a6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60832. Jul 20 14:21:42.053957 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] HTTP exception thrown: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Request method failure captured: Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d HTTP/1.1 Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdZmG8C_MCYYPXW2PKEaP4c-42tMbL9nzyX5KaFXJe2MrWRqfjgA_519xXHpt-sJBxg5XL3ZNmkCI2v577e190BWv9HrC9QNWgt1a5Cpi7pUuNsxa5PaCbAI-s3lzoyQP16b68WgPE1QAD4ZODxJT2g6LSdKI5qmcnZwjsR_UNXvEM Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:21:42.055765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}] Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: b55c81544d4342fb89dd8dbce3400fe4 Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.057708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '1aa1a351-f890-4b69-9606-4fa868d1443d'} Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:21:42.058576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.059980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.061425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Returning 404 to user: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:21:42.061425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1974bf20-d88b-42f5-baf3-9d334eee505f tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 404 len: 111 microversion: 2.1 time: 0.038208 Jul 20 14:21:42.061425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1533/2862] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:21:42 2022] DELETE /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:21:42.065998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:42.066596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] [instance: 1aa1a351-f890-4b69-9606-4fa868d1443d] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:42.072760 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.073414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.074364 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.074979 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.092029 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] HTTP exception thrown: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Request method failure captured: Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d HTTP/1.1 Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdZmG8C_MCYYPXW2PKEaP4c-42tMbL9nzyX5KaFXJe2MrWRqfjgA_519xXHpt-sJBxg5XL3ZNmkCI2v577e190BWv9HrC9QNWgt1a5Cpi7pUuNsxa5PaCbAI-s3lzoyQP16b68WgPE1QAD4ZODxJT2g6LSdKI5qmcnZwjsR_UNXvEM Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:21:42.093693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef1e44c6f9fc41ffaf49a0fec012031b"}]}] Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: ef1e44c6f9fc41ffaf49a0fec012031b Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566362918 Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: b55c81544d4342fb89dd8dbce3400fe4 Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeTestJSON-566362918-project Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.095259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '1aa1a351-f890-4b69-9606-4fa868d1443d'} Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:21:42.100744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. Jul 20 14:21:42.102321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.103865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] Returning 404 to user: Instance 1aa1a351-f890-4b69-9606-4fa868d1443d could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:21:42.103865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-88da92e8-a5d4-458f-b4d0-ee7803158ebe tempest-AttachVolumeTestJSON-566362918 tempest-AttachVolumeTestJSON-566362918-project] 10.222.0.17 "GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d" status: 404 len: 111 microversion: 2.1 time: 0.033026 Jul 20 14:21:42.103865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1534/2863] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:42 2022] GET /compute/v2.1/servers/1aa1a351-f890-4b69-9606-4fa868d1443d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:21:42.118187 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-67341601-44c8-4659-96e6-556381f4c898 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 204 len: 0 microversion: 2.1 time: 0.149505 Jul 20 14:21:42.118936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1330/2864] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:21:41 2022] DELETE /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:21:42.128354 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:42.129034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:42.136463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.137283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.138060 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.138496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.200151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:42.201027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] [instance: 8bf47794-d975-439d-85ed-1a2fd9cbd791] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:42.211228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.211651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.212495 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.212920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.228419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] HTTP exception thrown: Instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 could not be found. Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Request method failure captured: Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 HTTP/1.1 Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdhuJXNAbX8rwlzcFj8oh5gs5PcvAIJuqswdLVNDXB2-Z6P-0h35eJtyOSKUnM085Epek3ZVXgPia7-YZplhmUS8Qt_CqUHrIIyjGEnT656e_TrhVi8NEXpNBjvhijn4gbijhz6fbp839DYFp6euLjXLUL3dtDaPNE7xqHOQ1aaQus Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:21:42.230160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc6c042204f0471ba5c2f8a67604a802"}]}] Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: cc6c042204f0471ba5c2f8a67604a802 Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941054756 Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: f9cb52fe271348c1bc0ffda92063bf59 Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941054756-project Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 could not be found. Jul 20 14:21:42.231995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '8bf47794-d975-439d-85ed-1a2fd9cbd791'} Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 could not be found. Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:21:42.233010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 could not be found. Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 could not be found. Jul 20 14:21:42.234581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:42.235981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] Returning 404 to user: Instance 8bf47794-d975-439d-85ed-1a2fd9cbd791 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:21:42.236505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f6ed1687-4e98-499a-a946-10f3506f4a5c tempest-AttachVolumeShelveTestJSON-1941054756 tempest-AttachVolumeShelveTestJSON-1941054756-project] 10.222.0.17 "GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791" status: 404 len: 111 microversion: 2.20 time: 0.040055 Jul 20 14:21:42.243459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1331/2865] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jul 20 14:21:42 2022] GET /compute/v2.1/servers/8bf47794-d975-439d-85ed-1a2fd9cbd791 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 14:21:42.294072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:42.302315 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-cd358d6c-caf5-4832-a303-72a80da87874 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1508 microversion: 2.1 time: 0.179134 Jul 20 14:21:42.302872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1535/2866] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:42 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:21:42.461918 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-aea6a77e-6078-4f09-b1ea-dbe7c9bb4d70 req-2e5427f7-bb85-41d9-9742-532ffb7a9e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2c93bf-5a33-4636-9cad-26c1f1464734", "name": "network-vif-deleted", "tag": "d30f84b0-95c0-4dc4-a7a1-aff1a2df68e3"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:21:42.470145 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-aea6a77e-6078-4f09-b1ea-dbe7c9bb4d70 req-2e5427f7-bb85-41d9-9742-532ffb7a9e53 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:42.470582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-aea6a77e-6078-4f09-b1ea-dbe7c9bb4d70 req-2e5427f7-bb85-41d9-9742-532ffb7a9e53 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:42.482373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-aea6a77e-6078-4f09-b1ea-dbe7c9bb4d70 req-2e5427f7-bb85-41d9-9742-532ffb7a9e53 service nova] Creating event network-vif-deleted:d30f84b0-95c0-4dc4-a7a1-aff1a2df68e3 for instance 5c2c93bf-5a33-4636-9cad-26c1f1464734 on hv-cinder-81914 Jul 20 14:21:42.487533 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-aea6a77e-6078-4f09-b1ea-dbe7c9bb4d70 req-2e5427f7-bb85-41d9-9742-532ffb7a9e53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104348 Jul 20 14:21:42.488498 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1332/2867] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:21:43.321594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:43.322250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:43.329897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:43.330643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:43.331489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:43.332031 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:43.471316 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:43.480668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ec84f9b6-208a-46d0-b842-7a94130e51d3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1508 microversion: 2.1 time: 0.164118 Jul 20 14:21:43.481424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1536/2868] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:43 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:21:44.499482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:44.500230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:44.522449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-8abf351e-15a9-4f46-b99a-7150a7b484d5 req-38a0b49a-7dbf-4958-baa1-0271e16272c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aff7de0-b167-45a5-a897-cf138b503977", "name": "network-vif-deleted", "tag": "db9b4bf7-96c7-4b6e-b6fd-3290848317d5"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:21:44.538647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:44.539419 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:44.542314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:44.544091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:44.550181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-8abf351e-15a9-4f46-b99a-7150a7b484d5 req-38a0b49a-7dbf-4958-baa1-0271e16272c9 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:44.550749 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-8abf351e-15a9-4f46-b99a-7150a7b484d5 req-38a0b49a-7dbf-4958-baa1-0271e16272c9 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:44.582996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-8abf351e-15a9-4f46-b99a-7150a7b484d5 req-38a0b49a-7dbf-4958-baa1-0271e16272c9 service nova] Creating event network-vif-deleted:db9b4bf7-96c7-4b6e-b6fd-3290848317d5 for instance 9aff7de0-b167-45a5-a897-cf138b503977 on hv-cinder-81914 Jul 20 14:21:44.599382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-8abf351e-15a9-4f46-b99a-7150a7b484d5 req-38a0b49a-7dbf-4958-baa1-0271e16272c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085707 Jul 20 14:21:44.605820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1537/2869] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:21:44.619791 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:44.620372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:44.620892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.objects.instance [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lazy-loading 'fault' on Instance uuid 9aff7de0-b167-45a5-a897-cf138b503977 {{(pid=129542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 14:21:44.840065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:44.846856 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8794ff4d-4310-4e84-aba1-6c309d42de09 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 200 len: 1311 microversion: 2.1 time: 0.353081 Jul 20 14:21:44.847422 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1333/2870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:44 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 1311 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:21:45.866174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:45.867529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 9aff7de0-b167-45a5-a897-cf138b503977] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:45.883157 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:45.887494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:45.889848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:45.901022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:45.915775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] HTTP exception thrown: Instance 9aff7de0-b167-45a5-a897-cf138b503977 could not be found. Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Request method failure captured: Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 HTTP/1.1 Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2AdeirwC7UAYHUaPvCX0p4USyk_j0fsKkFCkvXzUZGvKTZhYw5K34ULuvN4sqXQEAOymvW7JfYWpJ7W9WautsqwdIA61j5aeKpNa63UbPFVwPl38o2F0NkOMJriYpp0Th9TILBFdJCWsD2aV3BCG4efbxsq_gQAjvFwNKUg1TG_pxrE Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: 4d8105a57b2a47d5851fc8ca3d13c9e3 Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:21:45.930873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}] Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: 4d8105a57b2a47d5851fc8ca3d13c9e3 Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-ServerRescueNegativeTestJSON-1442909024-project Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: 7c1d0edb03914ac69ebdb833ee1c2d75 Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442909024-project Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 9aff7de0-b167-45a5-a897-cf138b503977 could not be found. Jul 20 14:21:45.932731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '9aff7de0-b167-45a5-a897-cf138b503977'} Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aff7de0-b167-45a5-a897-cf138b503977 could not be found. Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:21:45.933707 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aff7de0-b167-45a5-a897-cf138b503977 could not be found. Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aff7de0-b167-45a5-a897-cf138b503977 could not be found. Jul 20 14:21:45.935304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:21:45.936765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Returning 404 to user: Instance 9aff7de0-b167-45a5-a897-cf138b503977 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:21:45.936765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-996c9a9d-c868-4dab-9e2e-35c7e1d1d5c3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977" status: 404 len: 111 microversion: 2.1 time: 0.071543 Jul 20 14:21:45.936765 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1538/2871] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:45 2022] GET /compute/v2.1/servers/9aff7de0-b167-45a5-a897-cf138b503977 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:21:45.941243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:45.941815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:45.957667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:45.958130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:45.959186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:45.960151 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:46.026380 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Going to try to terminate instance {{(pid=129542) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:21:46.182835 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8cc47a82-6ae9-447a-9e0a-544b8e2c7fc3 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 204 len: 0 microversion: 2.1 time: 0.245385 Jul 20 14:21:46.187157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1334/2872] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:21:45 2022] DELETE /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:21:46.195489 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:46.196262 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:46.206357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:46.206816 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:46.207586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:46.209928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:46.615225 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:46.624553 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9ce8f236-a464-45e6-bf4c-d855f524f2fa tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1522 microversion: 2.1 time: 0.433314 Jul 20 14:21:46.625416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1539/2873] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:46 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:21:47.639910 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-6bbfd41f-f547-4da7-8036-47e57f9a402f req-a8fe6dea-6b1c-448d-bcad-fbc75d8ca73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52fcfee5-9168-4461-8523-7471fd8e81e5", "name": "network-vif-deleted", "tag": "17a0147e-8a4a-49a4-88fb-0f4e99342246"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:21:47.642365 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:47.643054 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:47.654280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-6bbfd41f-f547-4da7-8036-47e57f9a402f req-a8fe6dea-6b1c-448d-bcad-fbc75d8ca73e service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:47.655079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-6bbfd41f-f547-4da7-8036-47e57f9a402f req-a8fe6dea-6b1c-448d-bcad-fbc75d8ca73e service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:47.671259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:47.671718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:47.680185 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-6bbfd41f-f547-4da7-8036-47e57f9a402f req-a8fe6dea-6b1c-448d-bcad-fbc75d8ca73e service nova] Creating event network-vif-deleted:17a0147e-8a4a-49a4-88fb-0f4e99342246 for instance 52fcfee5-9168-4461-8523-7471fd8e81e5 on hv-cinder-81914 Jul 20 14:21:47.681305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:47.681784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:47.687236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-6bbfd41f-f547-4da7-8036-47e57f9a402f req-a8fe6dea-6b1c-448d-bcad-fbc75d8ca73e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051933 Jul 20 14:21:47.688157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1335/2874] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:21:47.847736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1d0edb03914ac69ebdb833ee1c2d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:21:47.860819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8cff28cb-ade5-4551-ae80-e4459c6f27c0 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 200 len: 1307 microversion: 2.1 time: 0.222464 Jul 20 14:21:47.861646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1540/2875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:47 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:21:48.879137 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:21:48.880882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] [instance: 52fcfee5-9168-4461-8523-7471fd8e81e5] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:21:48.888849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:48.889549 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:48.890757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:21:48.891198 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:21:48.910267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] HTTP exception thrown: Instance 52fcfee5-9168-4461-8523-7471fd8e81e5 could not be found. Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Request method failure captured: Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 HTTP/1.1 Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2AdeirwC7UAYHUaPvCX0p4USyk_j0fsKkFCkvXzUZGvKTZhYw5K34ULuvN4sqXQEAOymvW7JfYWpJ7W9WautsqwdIA61j5aeKpNa63UbPFVwPl38o2F0NkOMJriYpp0Th9TILBFdJCWsD2aV3BCG4efbxsq_gQAjvFwNKUg1TG_pxrE Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 4d8105a57b2a47d5851fc8ca3d13c9e3 Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:21:48.912493 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8105a57b2a47d5851fc8ca3d13c9e3"}]}] Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 4d8105a57b2a47d5851fc8ca3d13c9e3 Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442909024 Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-ServerRescueNegativeTestJSON-1442909024-project Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: 7c1d0edb03914ac69ebdb833ee1c2d75 Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442909024-project Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 52fcfee5-9168-4461-8523-7471fd8e81e5 could not be found. Jul 20 14:21:48.914482 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '52fcfee5-9168-4461-8523-7471fd8e81e5'} Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52fcfee5-9168-4461-8523-7471fd8e81e5 could not be found. Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:21:48.915535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52fcfee5-9168-4461-8523-7471fd8e81e5 could not be found. Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52fcfee5-9168-4461-8523-7471fd8e81e5 could not be found. Jul 20 14:21:48.916950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:21:48.920086 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] Returning 404 to user: Instance 52fcfee5-9168-4461-8523-7471fd8e81e5 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:21:48.921386 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-920e596f-33e2-4355-acc1-ac81de7906a5 tempest-ServerRescueNegativeTestJSON-1442909024 tempest-ServerRescueNegativeTestJSON-1442909024-project] 10.222.0.17 "GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5" status: 404 len: 111 microversion: 2.1 time: 0.047138 Jul 20 14:21:48.927581 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1336/2876] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:21:48 2022] GET /compute/v2.1/servers/52fcfee5-9168-4461-8523-7471fd8e81e5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:21:57.602586 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2d2ff17a-d4f1-4a6c-b03b-273fa4728c75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: .version_select at 0x7fa40d30ac10>, body: {"keypair": {"name": "tempest-keypair-1970781911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPWQw+eM4cD4KmYN1KuvN8DEwu/zn0Jq2LYlIR31fBzQMXLnnYN/XhklcJoaDpqKHDIV1+0e9HaZvkxspLM5KUy1LNyqkkzfY4yp6qFDeK2cTZH+80KSkYvVB2LaBZVfg=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:21:57.623762 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-2d2ff17a-d4f1-4a6c-b03b-273fa4728c75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:21:57.627698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-2d2ff17a-d4f1-4a6c-b03b-273fa4728c75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:21:57.818753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2d2ff17a-d4f1-4a6c-b03b-273fa4728c75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.659788 Jul 20 14:21:57.827003 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1541/2877] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 14:21:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:21:59.440703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-850890820", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580d7049-af6d-4b21-b8f2-9a9533276a21"}], "security_groups": [{"name": "tempest-securitygroup--2009699709"}], "key_name": "tempest-keypair-1970781911", "user_data": "}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:21:59.455012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:59.456347 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:59.606106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] validate_networks() for [('580d7049-af6d-4b21-b8f2-9a9533276a21', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:22:00.347816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:22:00.348243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:22:00.348734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:22:00.349133 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:22:00.349535 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:22:00.361876 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:00.362395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:00.363257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:00.363681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:00.386708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:22:00.391309 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:22:00.404560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:22:00.407135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:22:00.461363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [4f8a886e-2d74-4c67-b99d-165c7ec0b901] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 14:22:01.470261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [4f8a886e-2d74-4c67-b99d-165c7ec0b901] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 33124. Jul 20 14:22:01.476958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-abdce4ac-5b4c-4e90-a785-9a95b6af0db8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.041994 Jul 20 14:22:01.483626 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1337/2878] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:21:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:22:01.484524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=38 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:01.490140 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-979457ba-2fff-495e-be5a-d8f53cf3ce46 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:01.490991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-979457ba-2fff-495e-be5a-d8f53cf3ce46 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:01.609813 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-979457ba-2fff-495e-be5a-d8f53cf3ce46 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:01.624117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-979457ba-2fff-495e-be5a-d8f53cf3ce46 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1241 microversion: 2.1 time: 0.140328 Jul 20 14:22:01.625468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1542/2879] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:01 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:02.641511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-10639d0c-bbc8-4647-afed-457d92490219 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:02.642117 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-10639d0c-bbc8-4647-afed-457d92490219 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:02.712563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-10639d0c-bbc8-4647-afed-457d92490219 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:02.720842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-10639d0c-bbc8-4647-afed-457d92490219 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1241 microversion: 2.1 time: 0.083548 Jul 20 14:22:02.732256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1338/2880] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:02 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:03.740701 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-64fb697c-cc63-4da3-b1f4-b6b33c5ec682 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:03.742170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-64fb697c-cc63-4da3-b1f4-b6b33c5ec682 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:03.798222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-64fb697c-cc63-4da3-b1f4-b6b33c5ec682 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:03.805768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-64fb697c-cc63-4da3-b1f4-b6b33c5ec682 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1241 microversion: 2.1 time: 0.071088 Jul 20 14:22:03.817199 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1543/2881] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:03 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:04.823072 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-25875ba2-fdb7-417a-ad6f-19d640706be1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:04.823660 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-25875ba2-fdb7-417a-ad6f-19d640706be1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:04.877306 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-25875ba2-fdb7-417a-ad6f-19d640706be1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:04.884521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-25875ba2-fdb7-417a-ad6f-19d640706be1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1241 microversion: 2.1 time: 0.065817 Jul 20 14:22:04.885109 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1339/2882] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:04 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:05.900869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:05.901479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:05.904671 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:22:05.905125 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:22:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:22:05.910033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:05.910033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:05.910319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:05.910735 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:05.977004 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:05.984835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7fe0c437-960c-4679-a9d5-64f22c8ef2e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1245 microversion: 2.1 time: 0.088341 Jul 20 14:22:05.985389 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1544/2883] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:05 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:07.001505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:07.002115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:07.009815 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:07.010267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:07.011209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:07.011654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:07.082654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:07.090922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-74076d88-3daf-4a24-a08e-f6c214bdee63 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1293 microversion: 2.1 time: 0.093095 Jul 20 14:22:07.100908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1340/2884] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:06 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:08.108322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:08.108980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:08.115280 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:08.115727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:08.116572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:08.116998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:08.177959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:08.185847 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bdf3e819-06b9-4fc1-beee-1d58fd0ecb00 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1293 microversion: 2.1 time: 0.081329 Jul 20 14:22:08.186397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1545/2885] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:08 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:09.202586 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:09.203310 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:09.210674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:09.211537 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:09.212822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:09.213515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:09.295796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:09.304449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3ba78c64-a020-4c67-8aa2-029dcbb55247 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1311 microversion: 2.1 time: 0.105526 Jul 20 14:22:09.305199 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1341/2886] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:09 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:10.321495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:10.322132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:10.328777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:10.329259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:10.330014 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:10.330476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:10.395431 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:10.403057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-380c1151-a5a1-4985-8d8e-b54ede87d284 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1299 microversion: 2.1 time: 0.085593 Jul 20 14:22:10.403608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1546/2887] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:10 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:11.420157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:11.420814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:11.423061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:11.428722 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:11.429165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:11.429919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:11.430349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:11.491118 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:11.498543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e0c69979-bf7f-4c40-85a1-ee6080d7cb92 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1299 microversion: 2.1 time: 0.082101 Jul 20 14:22:11.499097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1342/2888] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:11 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:12.515980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:12.516577 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:12.522182 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:12.525794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:12.526250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:12.527396 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:12.528009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:12.678271 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:12.688250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a2274dab-ae16-4998-bfa7-1707fddea898 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.176182 Jul 20 14:22:12.689693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1547/2889] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:12 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:13.052892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-6899f319-6acb-4a1e-a016-abc0e0771475 req-954bc32c-7ef3-4fd8-b416-c13c20c29f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eff9203-42ca-4546-8001-e230845451e6", "tag": "ab237d04-f05c-400b-a3de-cebaecfc6cb2"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:22:13.065424 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-6899f319-6acb-4a1e-a016-abc0e0771475 req-954bc32c-7ef3-4fd8-b416-c13c20c29f91 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:13.065909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-6899f319-6acb-4a1e-a016-abc0e0771475 req-954bc32c-7ef3-4fd8-b416-c13c20c29f91 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:13.083639 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-6899f319-6acb-4a1e-a016-abc0e0771475 req-954bc32c-7ef3-4fd8-b416-c13c20c29f91 service nova] Creating event network-changed:ab237d04-f05c-400b-a3de-cebaecfc6cb2 for instance 6eff9203-42ca-4546-8001-e230845451e6 on hv-cinder-81914 Jul 20 14:22:13.088652 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-6899f319-6acb-4a1e-a016-abc0e0771475 req-954bc32c-7ef3-4fd8-b416-c13c20c29f91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040338 Jul 20 14:22:13.089787 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1343/2890] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:22:13.709347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:13.710241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:13.719264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:13.719700 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:13.720781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:13.721281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:13.814399 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=8 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:13.817065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:22:13.817206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:22:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 (ip 10.222.0.17) !!! Jul 20 14:22:13.950056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:13.971327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-22859101-b0ae-4a72-b872-c3f33a0ddc68 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.269136 Jul 20 14:22:13.975774 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1548/2891] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:13 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:14.989410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=10 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:14.994308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:14.995019 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:15.001804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:15.002254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:15.003015 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:15.003451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:15.133865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:15.141512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cef9e3ec-abb7-4da7-99ac-3a2ee1964099 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.153508 Jul 20 14:22:15.147544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1344/2892] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:14 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:16.163657 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:16.164287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:16.170751 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:16.171195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:16.171949 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:16.172411 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:16.300080 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:16.308675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-98743d03-2f2b-47cf-a149-48618191a9be tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.148804 Jul 20 14:22:16.309241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1549/2893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:16 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:17.325385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:17.325954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:17.332361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:17.332811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:17.333823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:17.334253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:17.515010 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:17.522411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c9367e20-183d-4874-ac04-081ab612a6aa tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.200894 Jul 20 14:22:17.522980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1345/2894] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:17 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:18.539619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:18.540343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:18.547313 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:18.547763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:18.548557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:18.548992 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:18.685454 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:18.692893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9a9bafe7-730c-4257-8b3f-22d474f1d7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.157149 Jul 20 14:22:18.693476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1550/2895] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:18 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:19.710655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:19.711748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:19.718252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:19.718697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:19.719451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:19.719881 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:19.846344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:19.853708 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-788cc617-125e-400b-ba66-ea2f7768c239 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.147229 Jul 20 14:22:19.854270 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1346/2896] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:19 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:20.872087 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:20.872835 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:20.879432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:20.879888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:20.880672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:20.881246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:21.013695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:21.021408 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-15635399-8f3e-4c75-b8e9-bf7bacac83c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.153209 Jul 20 14:22:21.021969 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1551/2897] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:20 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:21.068440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-dc53d7c5-fa4d-47ee-902e-42dac1d999cc req-5481efbd-9e50-4c90-8bc5-ded644d4e7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eff9203-42ca-4546-8001-e230845451e6", "name": "network-vif-plugged", "status": "completed", "tag": "ab237d04-f05c-400b-a3de-cebaecfc6cb2"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:22:21.076343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-dc53d7c5-fa4d-47ee-902e-42dac1d999cc req-5481efbd-9e50-4c90-8bc5-ded644d4e7cb service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:21.076774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-dc53d7c5-fa4d-47ee-902e-42dac1d999cc req-5481efbd-9e50-4c90-8bc5-ded644d4e7cb service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:21.087914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-dc53d7c5-fa4d-47ee-902e-42dac1d999cc req-5481efbd-9e50-4c90-8bc5-ded644d4e7cb service nova] Creating event network-vif-plugged:ab237d04-f05c-400b-a3de-cebaecfc6cb2 for instance 6eff9203-42ca-4546-8001-e230845451e6 on hv-cinder-81914 Jul 20 14:22:21.092931 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-dc53d7c5-fa4d-47ee-902e-42dac1d999cc req-5481efbd-9e50-4c90-8bc5-ded644d4e7cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218362 Jul 20 14:22:21.093563 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1347/2898] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:22:22.038301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:22.038947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:22.045338 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:22.045839 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:22.046547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:22.046985 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:22.173545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:22.180895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-800f945b-3db4-4fc9-978f-71ea721e938f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.146432 Jul 20 14:22:22.181457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1552/2899] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:22 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:23.199066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:23.199770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:23.206416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:23.207097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:23.209209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:23.209656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:23.346219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:23.354400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1cc1b277-26a2-4a1e-bd65-464e599c04d6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1367 microversion: 2.1 time: 0.160256 Jul 20 14:22:23.354964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1348/2900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:23 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:24.370754 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:24.371359 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:24.377831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:24.378272 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:24.379021 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:24.379447 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:24.514237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:22:24.521563 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-88a952db-67b5-411e-9472-5163e8b73600 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1557 microversion: 2.1 time: 0.154602 Jul 20 14:22:24.522130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1553/2901] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:22:24 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:22:24.538021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a4ca1944-808e-4a70-990a-9bd9571e5f30 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:22:24.538542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a4ca1944-808e-4a70-990a-9bd9571e5f30 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:22:24.544825 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a4ca1944-808e-4a70-990a-9bd9571e5f30 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:24.545268 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a4ca1944-808e-4a70-990a-9bd9571e5f30 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:24.546014 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a4ca1944-808e-4a70-990a-9bd9571e5f30 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:24.546440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a4ca1944-808e-4a70-990a-9bd9571e5f30 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:24.621285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a4ca1944-808e-4a70-990a-9bd9571e5f30 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087028 Jul 20 14:22:24.621882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1349/2902] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 14:22:24 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:22:25.551684 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-541ef612-67ed-4dca-80ac-4973d135ea88 req-0042553b-c8ff-4c39-9e64-4308fb1d1377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eff9203-42ca-4546-8001-e230845451e6", "tag": "ab237d04-f05c-400b-a3de-cebaecfc6cb2"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:22:25.562002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-541ef612-67ed-4dca-80ac-4973d135ea88 req-0042553b-c8ff-4c39-9e64-4308fb1d1377 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:22:25.562437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-541ef612-67ed-4dca-80ac-4973d135ea88 req-0042553b-c8ff-4c39-9e64-4308fb1d1377 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:22:25.575333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-541ef612-67ed-4dca-80ac-4973d135ea88 req-0042553b-c8ff-4c39-9e64-4308fb1d1377 service nova] Creating event network-changed:ab237d04-f05c-400b-a3de-cebaecfc6cb2 for instance 6eff9203-42ca-4546-8001-e230845451e6 on hv-cinder-81914 Jul 20 14:22:25.581228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-541ef612-67ed-4dca-80ac-4973d135ea88 req-0042553b-c8ff-4c39-9e64-4308fb1d1377 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033114 Jul 20 14:22:25.582186 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1554/2903] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:09.274499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c0266980-7ba0-44e2-863c-9b7a73597e4a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:09.275130 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c0266980-7ba0-44e2-863c-9b7a73597e4a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:09.281650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:09.284267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=52 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:09.294324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c0266980-7ba0-44e2-863c-9b7a73597e4a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:09.295091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c0266980-7ba0-44e2-863c-9b7a73597e4a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:09.296110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c0266980-7ba0-44e2-863c-9b7a73597e4a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:09.296849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c0266980-7ba0-44e2-863c-9b7a73597e4a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:09.325279 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c0266980-7ba0-44e2-863c-9b7a73597e4a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/ips" status: 200 len: 149 microversion: 2.1 time: 0.055448 Jul 20 14:23:09.326174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1350/2904] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 14:23:09 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:10.968048 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=15 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:10.969438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=62 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:10.977931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-960550a4-61ad-4c53-a7f4-4ad4a7a5edab tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93fb2669-dcc0-4ebe-8a39-6be36f8c30d6"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:10.979220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-960550a4-61ad-4c53-a7f4-4ad4a7a5edab tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:10.987640 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-960550a4-61ad-4c53-a7f4-4ad4a7a5edab tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:10.987823 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-960550a4-61ad-4c53-a7f4-4ad4a7a5edab tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:10.988590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-960550a4-61ad-4c53-a7f4-4ad4a7a5edab tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:10.989024 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-960550a4-61ad-4c53-a7f4-4ad4a7a5edab tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:11.396413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-960550a4-61ad-4c53-a7f4-4ad4a7a5edab tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430407 Jul 20 14:23:11.399085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1555/2905] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 14:23:10 2022] POST /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:15.884061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-52d3a4e9-8062-48f2-93cb-dbe5ed33612e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Action: 'create', calling method: .version_select at 0x7fa40d331820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-881573416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHYdA1lIAp9rHkkG/+nDOcZtkpgEj8UzVD4Yo1osc93H7bOjksjqY0iqcAy8cqR+9yWAaW2WGckXs8xnZe59c4uqfbdDwz2X65bTHgqqWhQWbDWsaqWp9aw/bsLsoUqDA=="}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:15.897886 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-52d3a4e9-8062-48f2-93cb-dbe5ed33612e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Getting quotas for project 97a2d5a2afb34be58295ddc1586e9a31. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:23:15.901582 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-52d3a4e9-8062-48f2-93cb-dbe5ed33612e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Getting quotas for user d58cfae576584be28b93f15976a411af and project 97a2d5a2afb34be58295ddc1586e9a31. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:23:15.926297 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-52d3a4e9-8062-48f2-93cb-dbe5ed33612e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047125 Jul 20 14:23:15.926919 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1351/2906] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 14:23:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:16.026381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1238151405", "imageRef": "3e12ee95-2ba9-4c30-9e0b-d4fe5012eed7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-881573416", "networks": [{"uuid": "2f46d141-297b-4cfe-b51b-33b668c70997"}]}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:16.078890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] validate_networks() for [('2f46d141-297b-4cfe-b51b-33b668c70997', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:23:16.536179 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:23:16.536632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:23:16.537214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:23:16.538153 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:23:16.538591 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:23:16.547508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:16.547954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:16.548812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:16.549252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:16.565850 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Getting quotas for project 97a2d5a2afb34be58295ddc1586e9a31. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:23:16.569780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Getting quotas for user d58cfae576584be28b93f15976a411af and project 97a2d5a2afb34be58295ddc1586e9a31. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:23:16.580673 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:23:16.583451 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3e12ee95-2ba9-4c30-9e0b-d4fe5012eed7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:23:16.629020 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bc4c015a-d0ba-46b8-aac5-352749d75218 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607237 Jul 20 14:23:16.629679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1556/2907] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:23:16.640333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-30f1ec28-1cdd-4e29-946c-4dd3d3202ca8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:16.641215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-30f1ec28-1cdd-4e29-946c-4dd3d3202ca8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:16.696167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-30f1ec28-1cdd-4e29-946c-4dd3d3202ca8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:16.702936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-30f1ec28-1cdd-4e29-946c-4dd3d3202ca8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1258 microversion: 2.1 time: 0.066869 Jul 20 14:23:16.703492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1352/2908] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:16 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:17.724358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:17.725497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:17.732606 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:17.733045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:17.733874 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:17.734485 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:17.795435 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:17.803607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f77d2d15-f915-4a4e-9af4-2e949eaa9064 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1262 microversion: 2.1 time: 0.083821 Jul 20 14:23:17.804173 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1557/2909] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:17 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:18.825160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:18.826322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:18.834508 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:18.834953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:18.835712 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:18.836367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:18.909637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:18.930867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9f5f8a59-8bc2-4336-a454-3a8344b709c4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1316 microversion: 2.1 time: 0.109919 Jul 20 14:23:18.932311 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1353/2910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:18 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:19.087959 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-78a231e6-57d4-452d-aaa2-8ae70b58de9b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: .version_select at 0x7fa40d0d7c10>, body: {"keypair": {"name": "tempest-keypair-903861074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOIMPt4VjotH9SfSqH6QsvqJx6QRKPQxfk9BKFVJsK0qwO1SJLgcO4MSIqX2OGp0K4+Bcfc4K+nOK5sRRCQtvwAP8d+Od5pWxloLJdylKl7kpQ2jwokkRgegtzUjut4Jg=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:19.106791 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-78a231e6-57d4-452d-aaa2-8ae70b58de9b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:23:19.121923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-78a231e6-57d4-452d-aaa2-8ae70b58de9b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:23:19.160409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-78a231e6-57d4-452d-aaa2-8ae70b58de9b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076661 Jul 20 14:23:19.163305 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1558/2911] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 14:23:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:19.950207 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:19.952066 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:19.964679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:19.965448 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:19.970425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:19.971950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:20.341328 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:20.355702 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a530cb58-1cdc-436a-b78a-27a9e8ec0aa5 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.407452 Jul 20 14:23:20.359583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1354/2912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:19 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:20.982509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-4ee99c20-e042-4e0b-b5ee-7e16cf4da387 req-7678dd81-2e14-40eb-b585-7d8e5ea418c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e", "tag": "5942e44d-d688-4e13-b06a-43238c44b08d"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:21.001488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-4ee99c20-e042-4e0b-b5ee-7e16cf4da387 req-7678dd81-2e14-40eb-b585-7d8e5ea418c9 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:21.004328 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-4ee99c20-e042-4e0b-b5ee-7e16cf4da387 req-7678dd81-2e14-40eb-b585-7d8e5ea418c9 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:21.032808 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-4ee99c20-e042-4e0b-b5ee-7e16cf4da387 req-7678dd81-2e14-40eb-b585-7d8e5ea418c9 service nova] Creating event network-changed:5942e44d-d688-4e13-b06a-43238c44b08d for instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e on hv-cinder-81914 Jul 20 14:23:21.039993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-4ee99c20-e042-4e0b-b5ee-7e16cf4da387 req-7678dd81-2e14-40eb-b585-7d8e5ea418c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070270 Jul 20 14:23:21.041639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1559/2913] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:21.376174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:21.377529 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:21.392833 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:21.405018 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:21.406590 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:21.407363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:21.655866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2123015071", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580d7049-af6d-4b21-b8f2-9a9533276a21"}], "security_groups": [{"name": "tempest-securitygroup--556567054"}], "key_name": "tempest-keypair-903861074", "user_data": "}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:21.678283 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:21.686796 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-804c1953-446f-4109-b448-d503456bec58 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.316103 Jul 20 14:23:21.703623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1355/2914] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:21 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:21.823865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] validate_networks() for [('580d7049-af6d-4b21-b8f2-9a9533276a21', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:23:22.375537 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:23:22.376134 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:23:22.376665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:23:22.377068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:23:22.377473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:23:22.387608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:22.388381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:22.389392 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:22.390047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:22.410400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:23:22.415028 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:23:22.430012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:23:22.432425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:23:22.512666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-eaa577c6-b147-479a-89c7-b496e27c8e28 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.867838 Jul 20 14:23:22.514653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1560/2915] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:23:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:23:22.524000 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-98380f3a-60b0-40df-b999-f831ae1b85ca tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:22.524636 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-98380f3a-60b0-40df-b999-f831ae1b85ca tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:22.609892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-98380f3a-60b0-40df-b999-f831ae1b85ca tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:22.619841 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-98380f3a-60b0-40df-b999-f831ae1b85ca tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1241 microversion: 2.1 time: 0.099918 Jul 20 14:23:22.621650 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1356/2916] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:22 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:22.708046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:22.709377 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:22.723712 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:22.724458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:22.730035 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:22.730865 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:22.962974 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:22.982100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b00bc58d-4a77-4f61-ac1d-16a004528276 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.278979 Jul 20 14:23:22.983002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1561/2917] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:22 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:23.638426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:23.638426 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:23.647694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:23.648452 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:23.649558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:23.650167 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:23.742261 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:23.750677 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-e582e5fe-c012-4e8a-9b14-1be1b7cba0f3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1245 microversion: 2.1 time: 0.116848 Jul 20 14:23:23.751793 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1357/2918] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:23 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:24.000499 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:24.001130 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:24.012947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:24.013806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:24.014628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:24.015062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:24.171373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:24.179993 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3c74db0c-be9d-4a2a-a862-c26eb6257c9a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.183226 Jul 20 14:23:24.180594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1562/2919] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:23 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:23:24.778629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:24.779459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:24.786416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:24.787670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:24.788780 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:24.789388 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:24.857577 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:24.867831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7d526897-d518-4e74-8869-2acf2bee651b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1245 microversion: 2.1 time: 0.093190 Jul 20 14:23:24.877472 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1358/2920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:24 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:25.198479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:25.200002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:25.207290 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:25.208441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:25.209303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:25.209806 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:25.355778 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:25.363112 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8449453b-55b3-40f1-a033-16e9d52decf8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.168540 Jul 20 14:23:25.363899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1563/2921] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:25 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:25.887916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:25.888759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:25.896851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:25.897308 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:25.898076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:25.898700 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:25.972221 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:25.983511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f42297ec-655a-4693-8f40-ef83c8dacc15 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1245 microversion: 2.1 time: 0.102741 Jul 20 14:23:25.993734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1359/2922] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:25 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:26.379422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:26.380013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:26.386630 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:26.387074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:26.387842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:26.388632 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:26.548425 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:26.556175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0da0e025-cdb9-4ddf-ad84-2e842c64b64b tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.180691 Jul 20 14:23:26.556768 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1564/2923] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:26 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:27.001420 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:27.002335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:27.009105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:27.009820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:27.010681 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:27.011556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:27.100274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:27.109880 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d3e3c5b6-07ce-48af-8033-88d4e53183dd tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1245 microversion: 2.1 time: 0.112560 Jul 20 14:23:27.110624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1360/2924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:26 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:27.574197 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:27.574793 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:27.581269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:27.581718 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:27.582494 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:27.583169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:27.712755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:27.720100 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-c076029b-727e-429d-905d-078cb861ef2a tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.149766 Jul 20 14:23:27.720695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1565/2925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:27 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:28.126940 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:28.127687 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:28.134589 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:28.135032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:28.135779 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:28.136228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:28.199257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:28.207040 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-eef867da-15cc-4e99-9855-ab228961e92d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1245 microversion: 2.1 time: 0.084036 Jul 20 14:23:28.207854 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1361/2926] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:28 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:28.737278 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:28.737911 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:28.744592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:28.745038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:28.745917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:28.746428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:28.882674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:28.890099 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ea22a7e4-e867-4891-a5f8-f205ed7fb308 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.156851 Jul 20 14:23:28.890656 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1566/2927] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:28 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:29.224541 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:29.225315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:29.231670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:29.232102 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:29.233095 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:29.233697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:29.325843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:29.335958 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-28a60c3a-c226-46b6-b6de-5241ff0611a2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1237 microversion: 2.1 time: 0.115253 Jul 20 14:23:29.336562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1362/2928] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:29 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:29.907639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:29.908072 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:29.915475 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:29.915931 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:29.916828 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:29.917277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:30.053322 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:30.065367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-306ba06e-17f8-4ded-89c2-5d0b74307726 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.158282 Jul 20 14:23:30.065367 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1567/2929] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:29 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:23:30.353135 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:30.353850 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:30.361300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:30.361837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:30.362684 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:30.363189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:30.432521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:30.439954 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-89f6f700-afbf-42e0-9034-16c4e11dbfb8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1311 microversion: 2.1 time: 0.090795 Jul 20 14:23:30.440571 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1363/2930] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:30 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:31.081493 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:31.082998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:31.091210 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:31.091892 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:31.092899 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:31.093506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:31.344211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:31.356046 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6b32fbd8-e9fc-4d1d-b5ab-0cac4fd8d3aa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.278167 Jul 20 14:23:31.357925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1568/2931] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:31 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:31.459588 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:31.461129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:31.481228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:31.484657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:31.485661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:31.486414 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:31.648071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:31.657826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7c5182de-6f93-4d7f-b21d-de48e5c9907b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1366 microversion: 2.1 time: 0.203006 Jul 20 14:23:31.658354 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1364/2932] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:31 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:32.373655 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:32.374629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:32.375643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-517afe54-53f9-4b8f-84f2-4a8a4f528b0d req-a6b73db4-bff7-46c2-926a-2bee7445f12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ed4503-6e54-4006-85f5-53d06bdcf357", "tag": "973f85b0-d354-409d-8d2f-0453a11dc312"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:32.381790 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:32.382244 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:32.383223 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:32.383869 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:32.388015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-517afe54-53f9-4b8f-84f2-4a8a4f528b0d req-a6b73db4-bff7-46c2-926a-2bee7445f12d service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:32.388637 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-517afe54-53f9-4b8f-84f2-4a8a4f528b0d req-a6b73db4-bff7-46c2-926a-2bee7445f12d service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:32.415133 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=4 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:32.427558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=16 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:32.433342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-517afe54-53f9-4b8f-84f2-4a8a4f528b0d req-a6b73db4-bff7-46c2-926a-2bee7445f12d service nova] Creating event network-changed:973f85b0-d354-409d-8d2f-0453a11dc312 for instance d7ed4503-6e54-4006-85f5-53d06bdcf357 on hv-cinder-81914 Jul 20 14:23:32.439569 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-517afe54-53f9-4b8f-84f2-4a8a4f528b0d req-a6b73db4-bff7-46c2-926a-2bee7445f12d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409337 Jul 20 14:23:32.440458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1569/2933] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:32.542861 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:32.564916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-9868c1a3-6c54-4634-93cf-7284ee154176 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.189537 Jul 20 14:23:32.565614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1365/2934] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:32 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:23:32.675211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:32.675901 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:32.682335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:32.682709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:32.683521 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:32.683947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:32.825293 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:32.833152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-fd7391bf-9543-4007-9d9a-e33bd3688f96 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1366 microversion: 2.1 time: 0.161903 Jul 20 14:23:32.834628 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1570/2935] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:32 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:32.971762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-4d247a82-4356-4e8f-bc92-6afe43e927c4 req-fc1aa2b7-b659-45c8-b159-eadf6b0b7ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e", "name": "network-vif-plugged", "status": "completed", "tag": "5942e44d-d688-4e13-b06a-43238c44b08d"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:32.978543 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=8 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:32.980981 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-4d247a82-4356-4e8f-bc92-6afe43e927c4 req-fc1aa2b7-b659-45c8-b159-eadf6b0b7ba3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:32.981658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-4d247a82-4356-4e8f-bc92-6afe43e927c4 req-fc1aa2b7-b659-45c8-b159-eadf6b0b7ba3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:32.994438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-4d247a82-4356-4e8f-bc92-6afe43e927c4 req-fc1aa2b7-b659-45c8-b159-eadf6b0b7ba3 service nova] Creating event network-vif-plugged:5942e44d-d688-4e13-b06a-43238c44b08d for instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e on hv-cinder-81914 Jul 20 14:23:33.000848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-4d247a82-4356-4e8f-bc92-6afe43e927c4 req-fc1aa2b7-b659-45c8-b159-eadf6b0b7ba3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032831 Jul 20 14:23:33.001735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1366/2936] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:33.583195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:33.583986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:33.591875 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:33.592378 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:33.593162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:33.593593 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:33.852743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:33.853400 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:33.865409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:33.865894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:33.866690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:33.867124 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:33.995088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:34.002561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ddb9cb4c-87cf-402a-b6bd-2c547aff44d8 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1358 microversion: 2.1 time: 0.423532 Jul 20 14:23:34.003220 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1571/2937] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:33 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:34.055256 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:34.062618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-6bf06720-a865-4141-b001-1bc66c38a6c9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1366 microversion: 2.1 time: 0.215224 Jul 20 14:23:34.063219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1367/2938] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:33 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:23:35.022690 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:35.023288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:35.029888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.030416 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.031183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.031619 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.079826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:35.080475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:35.087685 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.088136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.088848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.089278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.179347 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:35.187723 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-17b304e0-b2ae-44ef-8dd9-7af96d28488c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1549 microversion: 2.1 time: 0.168842 Jul 20 14:23:35.188319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1572/2939] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:35 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:35.204812 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:35.205508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:35.213400 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.214096 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.214861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.215286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.236594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:35.252463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-26a64cf3-c233-406c-8e1c-92495b6d488a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1366 microversion: 2.1 time: 0.176594 Jul 20 14:23:35.253362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1368/2940] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:35 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:35.379169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:35.383132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:35.389470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-99bd5105-84d9-4b4d-b003-f4a3a3c58611 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1549 microversion: 2.1 time: 0.188624 Jul 20 14:23:35.390110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1573/2941] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:35 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:23:35.406761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:35.410497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:35.412020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Searching by: {'deleted': False, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31'} {{(pid=129542) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 14:23:35.419874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.420314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.421146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.421578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.519267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.multi_cell_list [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 14:23:35.618138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c8a1455e-e3ed-4f5a-8b02-dd1ef218958f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215690 Jul 20 14:23:35.618767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1369/2942] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jul 20 14:23:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:35.630758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:35.631438 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:35.639170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.639825 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.640624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:35.641051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:35.775343 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:35.783342 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f9438a81-2808-49d0-a507-088bb20881d0 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1549 microversion: 2.1 time: 0.158039 Jul 20 14:23:35.783910 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1574/2943] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:35 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:36.269433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:36.270043 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:36.277165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:36.277611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:36.278365 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:36.278795 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:36.282963 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=100 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:36.406900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:36.414206 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c6b20254-139b-4f9c-8e67-76611ae8c5ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1366 microversion: 2.1 time: 0.148728 Jul 20 14:23:36.414758 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1370/2944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:36 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:36.982061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-f1f9efba-fd99-4303-8134-9826c6e7e9bb req-4577de67-709f-4743-a23f-cd09dd3dddbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ed4503-6e54-4006-85f5-53d06bdcf357", "name": "network-vif-plugged", "status": "completed", "tag": "973f85b0-d354-409d-8d2f-0453a11dc312"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:36.991610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-f1f9efba-fd99-4303-8134-9826c6e7e9bb req-4577de67-709f-4743-a23f-cd09dd3dddbb service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:36.992117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-f1f9efba-fd99-4303-8134-9826c6e7e9bb req-4577de67-709f-4743-a23f-cd09dd3dddbb service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:37.010237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-f1f9efba-fd99-4303-8134-9826c6e7e9bb req-4577de67-709f-4743-a23f-cd09dd3dddbb service nova] Creating event network-vif-plugged:973f85b0-d354-409d-8d2f-0453a11dc312 for instance d7ed4503-6e54-4006-85f5-53d06bdcf357 on hv-cinder-81914 Jul 20 14:23:37.015361 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-f1f9efba-fd99-4303-8134-9826c6e7e9bb req-4577de67-709f-4743-a23f-cd09dd3dddbb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037210 Jul 20 14:23:37.016404 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1575/2945] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:37.337889 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-986d16e5-021d-4666-91a1-9e4644dd8197 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f957fc-0ba7-4195-b1c5-70174ed72124"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:37.339076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-986d16e5-021d-4666-91a1-9e4644dd8197 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:37.345842 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-986d16e5-021d-4666-91a1-9e4644dd8197 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:37.346281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-986d16e5-021d-4666-91a1-9e4644dd8197 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:37.347031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-986d16e5-021d-4666-91a1-9e4644dd8197 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:37.347460 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-986d16e5-021d-4666-91a1-9e4644dd8197 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:37.431860 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:37.432590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:37.438726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:37.439174 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:37.439938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:37.440405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:37.574221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:37.582366 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d3a891ca-ccea-4376-b2d6-f2c6c2ccf4ba tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1366 microversion: 2.1 time: 0.155283 Jul 20 14:23:37.583317 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1576/2946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:37 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:23:37.613103 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-986d16e5-021d-4666-91a1-9e4644dd8197 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280916 Jul 20 14:23:37.613776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1371/2947] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 14:23:37 2022] POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:23:38.600788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:38.601403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:38.608148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:38.608638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:38.609410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:38.609849 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:38.838782 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:38.846383 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-81201e8b-5d49-4e53-ab81-10176415ff85 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1366 microversion: 2.1 time: 0.249501 Jul 20 14:23:38.847160 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1577/2948] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:38 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:39.863968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:39.864686 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:39.870837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:39.871281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:39.872045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:39.872505 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:40.252464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:40.260264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-77bf1314-197b-4182-beab-02878a75b028 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1557 microversion: 2.1 time: 0.400968 Jul 20 14:23:40.260851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1372/2949] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:39 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1557 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:40.276695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d4045bbd-f438-4613-a053-028092b76242 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:40.277216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d4045bbd-f438-4613-a053-028092b76242 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:40.283608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4045bbd-f438-4613-a053-028092b76242 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:40.284051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4045bbd-f438-4613-a053-028092b76242 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:40.284853 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4045bbd-f438-4613-a053-028092b76242 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:40.285291 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d4045bbd-f438-4613-a053-028092b76242 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:40.362661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d4045bbd-f438-4613-a053-028092b76242 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089838 Jul 20 14:23:40.363300 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1578/2950] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 14:23:40 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:41.265278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-a2c58697-0061-4ecd-bdcb-1317b36d8983 req-f595fc18-b959-4b20-9fa1-36947f3bfb30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ed4503-6e54-4006-85f5-53d06bdcf357", "tag": "973f85b0-d354-409d-8d2f-0453a11dc312"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:41.273945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-a2c58697-0061-4ecd-bdcb-1317b36d8983 req-f595fc18-b959-4b20-9fa1-36947f3bfb30 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:41.274378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-a2c58697-0061-4ecd-bdcb-1317b36d8983 req-f595fc18-b959-4b20-9fa1-36947f3bfb30 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:41.285693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-a2c58697-0061-4ecd-bdcb-1317b36d8983 req-f595fc18-b959-4b20-9fa1-36947f3bfb30 service nova] Creating event network-changed:973f85b0-d354-409d-8d2f-0453a11dc312 for instance d7ed4503-6e54-4006-85f5-53d06bdcf357 on hv-cinder-81914 Jul 20 14:23:41.290816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-a2c58697-0061-4ecd-bdcb-1317b36d8983 req-f595fc18-b959-4b20-9fa1-36947f3bfb30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029136 Jul 20 14:23:41.291394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1373/2951] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:45.149089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:45.149698 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:45.151643 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:45.157047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:45.157495 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:45.158257 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:45.158693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:45.286733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:45.294579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2401fd79-6f20-4e56-b32a-05d88f4f69d4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1595 microversion: 2.1 time: 0.150021 Jul 20 14:23:45.295148 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1579/2952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:45 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1595 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:23:47.230058 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:47.234237 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-34a89892-dd06-4199-a19c-11c0c93652a5 req-bf78a934-2fc4-4925-a45a-d917d65f2218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e", "tag": "5942e44d-d688-4e13-b06a-43238c44b08d"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:47.238703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:47.244298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-34a89892-dd06-4199-a19c-11c0c93652a5 req-bf78a934-2fc4-4925-a45a-d917d65f2218 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:47.244298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-34a89892-dd06-4199-a19c-11c0c93652a5 req-bf78a934-2fc4-4925-a45a-d917d65f2218 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:47.256952 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-34a89892-dd06-4199-a19c-11c0c93652a5 req-bf78a934-2fc4-4925-a45a-d917d65f2218 service nova] Creating event network-changed:5942e44d-d688-4e13-b06a-43238c44b08d for instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e on hv-cinder-81914 Jul 20 14:23:47.262146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-34a89892-dd06-4199-a19c-11c0c93652a5 req-bf78a934-2fc4-4925-a45a-d917d65f2218 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033458 Jul 20 14:23:47.262964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1374/2953] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:23:48.217200 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-608205762"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:48.217752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:48.225131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:48.225584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:48.226368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:48.226803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:48.359951 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.network.security_group_api [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Adding security group 725f3f9b-a985-414c-b47c-1c6f5c845006 to port 5942e44d-d688-4e13-b06a-43238c44b08d Jul 20 14:23:48.709512 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-de3deb03-8efa-450d-9ad7-bc0474615949 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/action" status: 202 len: 0 microversion: 2.1 time: 0.496269 Jul 20 14:23:48.710716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1580/2954] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 14:23:48 2022] POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:23:48.719402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:23:48.720096 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:23:48.729085 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:48.730063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:48.731757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:48.732470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:48.894755 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:23:48.904003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ef4c7491-4126-41f5-91f9-3d63a3e51398 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1760 microversion: 2.1 time: 0.189154 Jul 20 14:23:48.904651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1375/2955] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:23:48 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1760 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:23:49.277051 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-dc839ab6-5f12-4ed4-9f4d-94cebcf3d9ef req-c8fd63de-07f1-4f8c-83a1-76557ed6175b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e", "tag": "5942e44d-d688-4e13-b06a-43238c44b08d"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:23:49.285095 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-dc839ab6-5f12-4ed4-9f4d-94cebcf3d9ef req-c8fd63de-07f1-4f8c-83a1-76557ed6175b service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:23:49.285540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-dc839ab6-5f12-4ed4-9f4d-94cebcf3d9ef req-c8fd63de-07f1-4f8c-83a1-76557ed6175b service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:23:49.304539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-dc839ab6-5f12-4ed4-9f4d-94cebcf3d9ef req-c8fd63de-07f1-4f8c-83a1-76557ed6175b service nova] Creating event network-changed:5942e44d-d688-4e13-b06a-43238c44b08d for instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e on hv-cinder-81914 Jul 20 14:23:49.311977 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-dc839ab6-5f12-4ed4-9f4d-94cebcf3d9ef req-c8fd63de-07f1-4f8c-83a1-76557ed6175b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038914 Jul 20 14:23:49.312884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1581/2956] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:24:12.508369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b20a433c-7300-47c2-9074-981fc3ab3e9c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:12.509374 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b20a433c-7300-47c2-9074-981fc3ab3e9c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:12.511720 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:12.512393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:12.518643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b20a433c-7300-47c2-9074-981fc3ab3e9c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:12.519092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b20a433c-7300-47c2-9074-981fc3ab3e9c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:12.520438 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b20a433c-7300-47c2-9074-981fc3ab3e9c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:12.520875 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b20a433c-7300-47c2-9074-981fc3ab3e9c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:12.592338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b20a433c-7300-47c2-9074-981fc3ab3e9c tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/action" status: 202 len: 0 microversion: 2.1 time: 0.088074 Jul 20 14:24:12.593076 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1376/2957] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 14:24:12 2022] POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:24:12.599339 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=5 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:12.600070 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=36 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:12.604575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:12.605397 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:12.613288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:12.613731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:12.614601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:12.615034 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:12.858876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:12.866792 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96c1443c-512a-4772-aa1f-00bc151c1898 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1752 microversion: 2.1 time: 0.269238 Jul 20 14:24:12.867368 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1582/2958] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:12 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1752 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:13.884908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:13.885730 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:13.891914 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:13.892404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:13.893173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:13.893605 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:14.032974 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:14.041427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3fc6e4af-4b18-41a4-949d-b3fc04c2a2dc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.161209 Jul 20 14:24:14.041995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1377/2959] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:13 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:15.058935 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:15.059561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:15.066861 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:15.067306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:15.068065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:15.068522 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:15.210286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:15.218088 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a0b54776-1f3d-43ca-9c80-87b3e11bd2af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.163224 Jul 20 14:24:15.218645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1583/2960] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:15 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:16.235633 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:16.236257 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:16.242705 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:16.243146 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:16.243900 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:16.244363 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:16.387209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:16.395719 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3666827a-4338-489a-86b0-0ab1a2036461 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.163882 Jul 20 14:24:16.396294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1378/2961] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:16 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:17.412741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:17.413358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:17.419773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.420250 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.421009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.421441 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.440416 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-609c7520-225b-4e13-9379-09c39045b0a6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:17.441585 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-609c7520-225b-4e13-9379-09c39045b0a6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:17.447983 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-609c7520-225b-4e13-9379-09c39045b0a6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.448470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-609c7520-225b-4e13-9379-09c39045b0a6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.449229 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-609c7520-225b-4e13-9379-09c39045b0a6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.449664 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-609c7520-225b-4e13-9379-09c39045b0a6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.473091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-609c7520-225b-4e13-9379-09c39045b0a6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357/ips" status: 200 len: 150 microversion: 2.1 time: 0.036585 Jul 20 14:24:17.473661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1379/2962] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 14:24:17 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:24:17.483772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93fb2669-dcc0-4ebe-8a39-6be36f8c30d6"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:17.484864 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:17.491212 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.491656 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.492446 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.492879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.568995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:17.571031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Invalid volume: volume 93fb2669-dcc0-4ebe-8a39-6be36f8c30d6 is already attached to instances: 6eff9203-42ca-4546-8001-e230845451e6 Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: POST /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357/os-volume_attachments HTTP/1.1 Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 74 Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:24:17.572855 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {"volumeAttachment": {"volumeId": "93fb2669-dcc0-4ebe-8a39-6be36f8c30d6"}} Jul 20 14:24:17.574486 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Invalid volume: volume 93fb2669-dcc0-4ebe-8a39-6be36f8c30d6 is already attached to instances: 6eff9203-42ca-4546-8001-e230845451e6 Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'server_id': 'd7ed4503-6e54-4006-85f5-53d06bdcf357', 'body': {'volumeAttachment': {'volumeId': '93fb2669-dcc0-4ebe-8a39-6be36f8c30d6'}}} Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 93fb2669-dcc0-4ebe-8a39-6be36f8c30d6 is already attached to instances: 6eff9203-42ca-4546-8001-e230845451e6 Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:17.575453 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 93fb2669-dcc0-4ebe-8a39-6be36f8c30d6 is already attached to instances: 6eff9203-42ca-4546-8001-e230845451e6 Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:17.576901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 93fb2669-dcc0-4ebe-8a39-6be36f8c30d6 is already attached to instances: 6eff9203-42ca-4546-8001-e230845451e6 Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 400 to user: Invalid volume: volume 93fb2669-dcc0-4ebe-8a39-6be36f8c30d6 is already attached to instances: 6eff9203-42ca-4546-8001-e230845451e6 {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-24eaeff3-b249-4bc6-a571-33639084d52a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094166 Jul 20 14:24:17.579305 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1380/2963] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 14:24:17 2022] POST /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 14:24:17.580026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1489e6b2-555c-4a45-8176-f7972df1ef85 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.168195 Jul 20 14:24:17.580026 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1584/2964] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:17 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:17.585946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:17.586466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:17.592932 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.593378 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.594136 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.594565 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.620001 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Going to try to terminate instance {{(pid=129542) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:24:17.694920 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5090f442-1a38-418a-9178-71e1db748e4d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 204 len: 0 microversion: 2.1 time: 0.115151 Jul 20 14:24:17.695510 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1381/2965] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:24:17 2022] DELETE /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:24:17.704110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:17.704796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:17.711078 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.711528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.712310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:17.712742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:17.839228 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:17.846558 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-88ac5afd-e34a-43be-a421-b3dfea8832a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1681 microversion: 2.1 time: 0.146435 Jul 20 14:24:17.847597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1585/2966] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:17 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:18.597372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:18.598093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:18.605065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:18.605513 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:18.606281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:18.606717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:18.750573 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:18.758879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ab6df448-098e-433e-92da-3afaa5c661a6 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.167936 Jul 20 14:24:18.759435 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1382/2967] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:18 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:18.864457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:18.865022 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:18.871439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:18.871882 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:18.872674 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:18.873105 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:19.002897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:19.010864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5e493d3d-a5bb-4cc3-90af-6467c5b121d9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1681 microversion: 2.1 time: 0.150895 Jul 20 14:24:19.011413 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1586/2968] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:18 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:19.775848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:19.776469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:19.782606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:19.783054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:19.783812 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:19.784272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:19.937506 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:19.946092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-bee83dd2-6ac0-4fdf-90c2-03dbc1b3bdfa tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.174014 Jul 20 14:24:19.946657 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1383/2969] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:19 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:20.027971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:20.028744 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:20.036213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:20.037056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:20.038117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:20.038639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:20.075759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-ae113b60-e15b-4971-94ef-c801e8118dec req-6d209f9e-e7b1-4095-9906-55f6a9ce9b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ed4503-6e54-4006-85f5-53d06bdcf357", "name": "network-vif-deleted", "tag": "973f85b0-d354-409d-8d2f-0453a11dc312"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:20.085371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-ae113b60-e15b-4971-94ef-c801e8118dec req-6d209f9e-e7b1-4095-9906-55f6a9ce9b30 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:20.085987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-ae113b60-e15b-4971-94ef-c801e8118dec req-6d209f9e-e7b1-4095-9906-55f6a9ce9b30 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:20.101714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-ae113b60-e15b-4971-94ef-c801e8118dec req-6d209f9e-e7b1-4095-9906-55f6a9ce9b30 service nova] Creating event network-vif-deleted:973f85b0-d354-409d-8d2f-0453a11dc312 for instance d7ed4503-6e54-4006-85f5-53d06bdcf357 on hv-cinder-81914 Jul 20 14:24:20.109606 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-ae113b60-e15b-4971-94ef-c801e8118dec req-6d209f9e-e7b1-4095-9906-55f6a9ce9b30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037026 Jul 20 14:24:20.110737 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1384/2970] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:24:20.126039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:20.134394 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-456c4f2c-50ac-41c0-aa97-3b50d3517bda tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 200 len: 1614 microversion: 2.1 time: 0.110199 Jul 20 14:24:20.135075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1587/2971] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:20 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 1614 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:20.964027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:20.964757 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:20.971693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:20.972389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:20.973189 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:20.973627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:21.119166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:21.133260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-500a3e66-140a-453d-845e-b2f7800df8f4 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.173192 Jul 20 14:24:21.134277 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1385/2972] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:20 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:21.151002 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:21.151605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:21.158007 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:21.158449 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:21.159202 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:21.159664 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:21.172757 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 HTTP/1.1 Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:24:21.174395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:24:21.176308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': 'd7ed4503-6e54-4006-85f5-53d06bdcf357'} Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:24:21.177314 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:24:21.178967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:24:21.180496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:24:21.180496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f70fe4ab-0b28-4447-a058-bd678fe215e8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 404 len: 111 microversion: 2.1 time: 0.028620 Jul 20 14:24:21.180496 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1588/2973] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:21 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:24:21.184579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-722f57ca-c73f-4f91-9d39-1bb50bddfe3a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '.version_select at 0x7fa40d641c10>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:21.201843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-722f57ca-c73f-4f91-9d39-1bb50bddfe3a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903861074" status: 202 len: 0 microversion: 2.1 time: 0.020980 Jul 20 14:24:21.202402 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1386/2974] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 14:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903861074 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:24:21.855557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:21.856047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:21.861981 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:21.862448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:21.863803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:21.864269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:21.942546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lazy-loading 'services' on Instance uuid 6eff9203-42ca-4546-8001-e230845451e6 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 14:24:22.013589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-550228a5-57ad-4015-a423-06ae853d1ded tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments/93fb2669-dcc0-4ebe-8a39-6be36f8c30d6" status: 202 len: 0 microversion: 2.1 time: 0.161377 Jul 20 14:24:22.014170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1589/2975] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 14:24:21 2022] DELETE /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments/93fb2669-dcc0-4ebe-8a39-6be36f8c30d6 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:24:22.023362 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1e0323a1-d37e-4f01-958c-c1d12ed6af1f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:22.024329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1e0323a1-d37e-4f01-958c-c1d12ed6af1f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:22.031459 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0323a1-d37e-4f01-958c-c1d12ed6af1f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:22.031970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0323a1-d37e-4f01-958c-c1d12ed6af1f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:22.032771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0323a1-d37e-4f01-958c-c1d12ed6af1f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:22.033258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1e0323a1-d37e-4f01-958c-c1d12ed6af1f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:22.063070 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1e0323a1-d37e-4f01-958c-c1d12ed6af1f tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Jul 20 14:24:22.063616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1387/2976] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:24:22 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:24:22.151357 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:22.151978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:22.158804 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:22.159252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:22.160714 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:22.161142 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:22.301725 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:22.309703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-30088bb0-f40d-4fbd-b238-2dc062250038 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.162551 Jul 20 14:24:22.310259 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1590/2977] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:22 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:23.073843 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-adff93ea-7417-4547-9eea-d80d86a5ba7d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:23.074788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-adff93ea-7417-4547-9eea-d80d86a5ba7d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:23.081329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adff93ea-7417-4547-9eea-d80d86a5ba7d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.081776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adff93ea-7417-4547-9eea-d80d86a5ba7d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.082792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adff93ea-7417-4547-9eea-d80d86a5ba7d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.083227 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-adff93ea-7417-4547-9eea-d80d86a5ba7d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.110713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-adff93ea-7417-4547-9eea-d80d86a5ba7d tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040733 Jul 20 14:24:23.111278 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1388/2978] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:24:23 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 14:24:23.169244 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:23.170170 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:23.177318 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.177766 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.178520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.178953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.204421 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:24:23.286205 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-efec2bcf-23c6-4cb8-a88f-1e496ee5e483 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 204 len: 0 microversion: 2.1 time: 0.118106 Jul 20 14:24:23.286980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1591/2979] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:24:23 2022] DELETE /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:24:23.295232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:23.295847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:23.302668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.303127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.303902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.304409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.327149 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:23.328033 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:23.334775 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.335219 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.335978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:23.336436 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:23.435165 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:23.443367 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fd0f54a6-c1b9-456d-bfb2-082d5b5c4587 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1681 microversion: 2.1 time: 0.152026 Jul 20 14:24:23.443937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1389/2980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:23 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:24:23.478675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:23.486498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-87a74c2d-f976-4957-8abf-6ecf7e918186 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.163642 Jul 20 14:24:23.487059 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1592/2981] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:23 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:24:24.460948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:24.461553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:24.468343 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:24.468798 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:24.469554 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:24.469994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:24.505601 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:24.506215 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:24.512834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:24.513279 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:24.514047 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:24.514483 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:24.603320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:24.611728 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4eb70656-712a-4d1f-8659-06269ca7b7fb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1681 microversion: 2.1 time: 0.154999 Jul 20 14:24:24.613264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1390/2982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:24 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:24.664625 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:24.672502 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1eea7678-0442-48de-a4cb-c6971b619527 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1757 microversion: 2.1 time: 0.171505 Jul 20 14:24:24.673055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1593/2983] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:24 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:24:25.629395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:25.630042 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:25.636734 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:25.637179 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:25.637943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:25.638372 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:25.689239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:25.689848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:25.697470 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:25.697914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:25.698711 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:25.699152 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:25.780216 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:25.783754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:25.790250 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3f3195bc-8e3b-4770-a487-7c6b87a213c4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1681 microversion: 2.1 time: 0.164679 Jul 20 14:24:25.790839 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1391/2984] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:25 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:26.169574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:26.177468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-b5e6216e-8ef1-4c2a-91cc-c4d5f1857e90 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1760 microversion: 2.1 time: 0.492149 Jul 20 14:24:26.178045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1594/2985] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:25 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1760 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:24:26.743128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-49b8c714-69f6-4d3d-ac36-dc38582cfb22 req-fef09864-c451-4e40-9bbe-d178e2441430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eff9203-42ca-4546-8001-e230845451e6", "name": "network-vif-deleted", "tag": "ab237d04-f05c-400b-a3de-cebaecfc6cb2"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:26.768158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-49b8c714-69f6-4d3d-ac36-dc38582cfb22 req-fef09864-c451-4e40-9bbe-d178e2441430 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:26.770941 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-49b8c714-69f6-4d3d-ac36-dc38582cfb22 req-fef09864-c451-4e40-9bbe-d178e2441430 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:26.810670 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:26.811803 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:26.813544 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-49b8c714-69f6-4d3d-ac36-dc38582cfb22 req-fef09864-c451-4e40-9bbe-d178e2441430 service nova] Creating event network-vif-deleted:ab237d04-f05c-400b-a3de-cebaecfc6cb2 for instance 6eff9203-42ca-4546-8001-e230845451e6 on hv-cinder-81914 Jul 20 14:24:26.828376 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-49b8c714-69f6-4d3d-ac36-dc38582cfb22 req-fef09864-c451-4e40-9bbe-d178e2441430 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090248 Jul 20 14:24:26.829794 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1392/2986] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:24:26.836437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:26.837572 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:26.839211 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:26.840266 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:26.934528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:26.943245 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4605b42a-ef15-4126-95f4-95936a616fe6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 200 len: 1326 microversion: 2.1 time: 0.139854 Jul 20 14:24:26.943871 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1595/2987] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:26 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 1326 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:27.961936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:27.962629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:27.968916 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:27.969364 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:27.970122 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:27.970556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:27.983658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 HTTP/1.1 Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:24:27.985298 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:24:27.987052 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '6eff9203-42ca-4546-8001-e230845451e6'} Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:24:27.988039 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:24:27.989703 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:24:27.991176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:24:27.991176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7f1d04ee-d84a-4882-a202-3e39ed461ab5 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 404 len: 111 microversion: 2.1 time: 0.030306 Jul 20 14:24:27.991176 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1393/2988] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:27 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:24:27.995330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-3fdc98e9-5161-44f3-9532-97aa33f4197c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '.version_select at 0x7fa40d1ac280>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:28.012444 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-3fdc98e9-5161-44f3-9532-97aa33f4197c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970781911" status: 202 len: 0 microversion: 2.1 time: 0.020831 Jul 20 14:24:28.013523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1596/2989] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 14:24:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970781911 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:24:28.621879 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-16cd09cf-62d5-4444-82d2-572a986bf75b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: .version_select at 0x7fa40d3c39d0>, body: {"keypair": {"name": "tempest-keypair-1558179539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktolki+ohwj3ViGgXWqJxNojvTshzZoLJAc7qycEPw6av9gwFgpCfaklIjCyEABGS7FU1BM+e8Imr13fXCoWcG8KusjWQD4tTJ2a7dgxWYTi57ES4kOQI4s611/rIsfQ=="}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:28.636132 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-16cd09cf-62d5-4444-82d2-572a986bf75b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:24:28.639810 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-16cd09cf-62d5-4444-82d2-572a986bf75b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:24:28.661291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-16cd09cf-62d5-4444-82d2-572a986bf75b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043285 Jul 20 14:24:28.661871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1394/2990] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 14:24:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:24:29.914044 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-897499349", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580d7049-af6d-4b21-b8f2-9a9533276a21"}], "security_groups": [{"name": "tempest-securitygroup--936390400"}], "key_name": "tempest-keypair-1558179539", "user_data": "}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:30.014789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] validate_networks() for [('580d7049-af6d-4b21-b8f2-9a9533276a21', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:24:30.378580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:24:30.379005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:24:30.379472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:24:30.379876 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:24:30.380352 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:24:30.389177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:30.389624 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:30.390445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:30.390884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:30.407554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:24:30.412077 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:24:30.422887 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:24:30.425131 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:24:30.469136 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4984731e-b4e3-429e-adfd-eef20828f117 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.560522 Jul 20 14:24:30.469779 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1597/2991] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:24:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:24:30.481147 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cb182b09-da75-4f0b-a687-73ea926faf2e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:30.481903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cb182b09-da75-4f0b-a687-73ea926faf2e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:30.538129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cb182b09-da75-4f0b-a687-73ea926faf2e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:30.545405 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cb182b09-da75-4f0b-a687-73ea926faf2e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1241 microversion: 2.1 time: 0.068195 Jul 20 14:24:30.547557 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1395/2992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:30 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:31.563308 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:31.563912 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:31.570382 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:31.570842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:31.571638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:31.572820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:31.592605 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:31.652873 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:31.660702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-334f8184-4e21-4bf5-9d1e-3cbd2cb3b866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1299 microversion: 2.1 time: 0.101774 Jul 20 14:24:31.661263 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1598/2993] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:31 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:32.679489 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:32.680596 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:32.687980 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:32.688614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:32.689501 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:32.690318 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:32.817895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-5809d5b9-097d-415c-9e1c-e03e5a601e24 req-9a1d3a6e-a5b6-4378-8462-ad28e395ce9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7", "tag": "0bc1e5fb-f036-4321-b33d-0c36c01cd574"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:32.830264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-5809d5b9-097d-415c-9e1c-e03e5a601e24 req-9a1d3a6e-a5b6-4378-8462-ad28e395ce9f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:32.830794 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-5809d5b9-097d-415c-9e1c-e03e5a601e24 req-9a1d3a6e-a5b6-4378-8462-ad28e395ce9f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:32.846380 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-5809d5b9-097d-415c-9e1c-e03e5a601e24 req-9a1d3a6e-a5b6-4378-8462-ad28e395ce9f service nova] Creating event network-changed:0bc1e5fb-f036-4321-b33d-0c36c01cd574 for instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 on hv-cinder-81914 Jul 20 14:24:32.851665 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-5809d5b9-097d-415c-9e1c-e03e5a601e24 req-9a1d3a6e-a5b6-4378-8462-ad28e395ce9f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039504 Jul 20 14:24:32.852274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1599/2994] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:24:32.857200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:32.865713 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c5184eb2-6c2c-4c34-834d-1585ede02a5e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1366 microversion: 2.1 time: 0.192039 Jul 20 14:24:32.866292 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1396/2995] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:32 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:33.883298 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:33.884085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:33.890776 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:33.891233 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:33.891991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:33.892463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:34.020089 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:34.027742 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2655566d-1666-4102-987e-3a1234a16342 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1366 microversion: 2.1 time: 0.148617 Jul 20 14:24:34.028349 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1600/2996] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:33 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:35.044845 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:35.045439 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:35.052036 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:35.052517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:35.053281 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:35.053714 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:35.182409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:35.189772 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-09b706a9-0fd1-4754-bba3-455270c1ef52 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1366 microversion: 2.1 time: 0.148823 Jul 20 14:24:35.190865 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1397/2997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:35 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:36.206733 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:36.207579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:36.214166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:36.214613 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:36.215373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:36.215810 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:36.344731 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:36.352708 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2810edbc-604b-45c8-adde-306222c448d0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1366 microversion: 2.1 time: 0.149821 Jul 20 14:24:36.353270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1601/2998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:36 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:37.368965 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:37.369576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:37.376074 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:37.376553 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:37.377307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:37.377765 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:37.505693 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:37.513661 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-2e345fd2-84f6-42bd-ac58-f2132817e6f2 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1366 microversion: 2.1 time: 0.148480 Jul 20 14:24:37.514241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1398/2999] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:37 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:38.530890 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:38.531513 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:38.540921 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:38.541592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:38.542752 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:38.543410 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:38.681857 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:38.689162 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6354a4f7-7703-4cf6-8c0b-25059ecca9f1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1366 microversion: 2.1 time: 0.162159 Jul 20 14:24:38.689720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1602/3000] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:38 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:39.212776 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-70b36e8f-ff52-4e77-9949-37afb0e66565 req-ada2d94a-1793-40d7-b50d-fd3d6946f46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7", "name": "network-vif-plugged", "status": "completed", "tag": "0bc1e5fb-f036-4321-b33d-0c36c01cd574"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:39.224054 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-70b36e8f-ff52-4e77-9949-37afb0e66565 req-ada2d94a-1793-40d7-b50d-fd3d6946f46e service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:39.224523 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-70b36e8f-ff52-4e77-9949-37afb0e66565 req-ada2d94a-1793-40d7-b50d-fd3d6946f46e service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:39.241666 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-70b36e8f-ff52-4e77-9949-37afb0e66565 req-ada2d94a-1793-40d7-b50d-fd3d6946f46e service nova] Creating event network-vif-plugged:0bc1e5fb-f036-4321-b33d-0c36c01cd574 for instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 on hv-cinder-81914 Jul 20 14:24:39.247515 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-70b36e8f-ff52-4e77-9949-37afb0e66565 req-ada2d94a-1793-40d7-b50d-fd3d6946f46e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039441 Jul 20 14:24:39.249333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1399/3001] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:24:39.705528 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:39.706798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:39.713627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:39.714075 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:39.714851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:39.715286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:39.915409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:39.922864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f7a3fe7e-a714-41e5-a753-98f94552a1c3 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1366 microversion: 2.1 time: 0.221121 Jul 20 14:24:39.923645 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1603/3002] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:39 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:40.937816 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:40.942628 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:40.943417 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:40.949884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:40.950333 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:40.951091 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:40.951524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:41.080032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:24:41.087805 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1c592ed2-fcda-4cdf-9b0e-a7b700468772 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1557 microversion: 2.1 time: 0.151455 Jul 20 14:24:41.088398 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1400/3003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:24:40 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:24:41.103703 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-04644710-603e-4cf8-822d-f258dbb68de0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:24:41.104239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-04644710-603e-4cf8-822d-f258dbb68de0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:24:41.106177 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:41.106968 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=6 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:41.113819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04644710-603e-4cf8-822d-f258dbb68de0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:41.114268 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04644710-603e-4cf8-822d-f258dbb68de0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:41.115045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04644710-603e-4cf8-822d-f258dbb68de0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:41.115482 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-04644710-603e-4cf8-822d-f258dbb68de0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:41.200374 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-04644710-603e-4cf8-822d-f258dbb68de0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100478 Jul 20 14:24:41.200971 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1604/3004] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 14:24:41 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:24:42.104617 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-801315bc-e1f7-46cb-abcc-ddbbd2fcf678 req-c3166676-e196-4ff1-91cd-fbd2a6735ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7", "tag": "0bc1e5fb-f036-4321-b33d-0c36c01cd574"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:24:42.113314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-801315bc-e1f7-46cb-abcc-ddbbd2fcf678 req-c3166676-e196-4ff1-91cd-fbd2a6735ff1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:24:42.113752 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-801315bc-e1f7-46cb-abcc-ddbbd2fcf678 req-c3166676-e196-4ff1-91cd-fbd2a6735ff1 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:24:42.124469 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-801315bc-e1f7-46cb-abcc-ddbbd2fcf678 req-c3166676-e196-4ff1-91cd-fbd2a6735ff1 service nova] Creating event network-changed:0bc1e5fb-f036-4321-b33d-0c36c01cd574 for instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 on hv-cinder-81914 Jul 20 14:24:42.129539 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-801315bc-e1f7-46cb-abcc-ddbbd2fcf678 req-c3166676-e196-4ff1-91cd-fbd2a6735ff1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028495 Jul 20 14:24:42.130228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1401/3005] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:05.178746 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:05.179598 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=32 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:05.183970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-608205762"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:05.184532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:05.191716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:05.192166 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:05.192953 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:05.193386 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:05.322103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.network.security_group_api [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Removing security group 725f3f9b-a985-414c-b47c-1c6f5c845006 from port 5942e44d-d688-4e13-b06a-43238c44b08d Jul 20 14:25:05.658610 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-97556db4-025e-44d4-849d-7c73610e391e tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/action" status: 202 len: 0 microversion: 2.1 time: 0.481022 Jul 20 14:25:05.664517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1605/3006] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jul 20 14:25:05 2022] POST /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:25:05.671946 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-aa48a4b1-1f21-4ff0-b641-8b3676096795 req-a97f308c-79ee-4937-b9ae-1d7c7cec1f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e", "tag": "5942e44d-d688-4e13-b06a-43238c44b08d"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:05.698548 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:05.699534 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=32 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:05.702745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-aa48a4b1-1f21-4ff0-b641-8b3676096795 req-a97f308c-79ee-4937-b9ae-1d7c7cec1f45 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:05.703646 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-aa48a4b1-1f21-4ff0-b641-8b3676096795 req-a97f308c-79ee-4937-b9ae-1d7c7cec1f45 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:05.720393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-aa48a4b1-1f21-4ff0-b641-8b3676096795 req-a97f308c-79ee-4937-b9ae-1d7c7cec1f45 service nova] Creating event network-changed:5942e44d-d688-4e13-b06a-43238c44b08d for instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e on hv-cinder-81914 Jul 20 14:25:05.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-aa48a4b1-1f21-4ff0-b641-8b3676096795 req-a97f308c-79ee-4937-b9ae-1d7c7cec1f45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059506 Jul 20 14:25:05.728922 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1402/3007] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:06.722720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:06.723344 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:06.725455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-d2343601-18f0-4434-8f24-b07c3ff1a853 req-b545530b-691b-42dd-b8f5-96e4ae3775f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e", "tag": "5942e44d-d688-4e13-b06a-43238c44b08d"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:06.729649 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:06.730212 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:06.731069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:06.731741 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:06.735594 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-d2343601-18f0-4434-8f24-b07c3ff1a853 req-b545530b-691b-42dd-b8f5-96e4ae3775f3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:06.736627 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-d2343601-18f0-4434-8f24-b07c3ff1a853 req-b545530b-691b-42dd-b8f5-96e4ae3775f3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:06.749726 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-d2343601-18f0-4434-8f24-b07c3ff1a853 req-b545530b-691b-42dd-b8f5-96e4ae3775f3 service nova] Creating event network-changed:5942e44d-d688-4e13-b06a-43238c44b08d for instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e on hv-cinder-81914 Jul 20 14:25:06.754844 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-d2343601-18f0-4434-8f24-b07c3ff1a853 req-b545530b-691b-42dd-b8f5-96e4ae3775f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034700 Jul 20 14:25:06.755450 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1403/3008] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:25:06.821440 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lazy-loading 'services' on Instance uuid bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 14:25:06.903557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-76aefb4f-a14a-4201-9303-9245030837bc tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments/65f957fc-0ba7-4195-b1c5-70174ed72124" status: 202 len: 0 microversion: 2.1 time: 0.185438 Jul 20 14:25:06.904363 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1606/3009] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 14:25:06 2022] DELETE /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments/65f957fc-0ba7-4195-b1c5-70174ed72124 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:25:06.923163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0c806153-e0cf-4072-8a5f-63e1926147af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:06.924232 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0c806153-e0cf-4072-8a5f-63e1926147af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:06.940877 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c806153-e0cf-4072-8a5f-63e1926147af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:06.941335 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c806153-e0cf-4072-8a5f-63e1926147af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:06.942128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c806153-e0cf-4072-8a5f-63e1926147af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:06.942562 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0c806153-e0cf-4072-8a5f-63e1926147af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:06.980017 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0c806153-e0cf-4072-8a5f-63e1926147af tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069309 Jul 20 14:25:06.980944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1404/3010] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:25:06 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:07.992908 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d909f359-d259-4a76-b4d4-b299f154dc2d tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:07.993989 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d909f359-d259-4a76-b4d4-b299f154dc2d tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:08.000267 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d909f359-d259-4a76-b4d4-b299f154dc2d tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:08.000720 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d909f359-d259-4a76-b4d4-b299f154dc2d tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:08.001477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d909f359-d259-4a76-b4d4-b299f154dc2d tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:08.001914 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d909f359-d259-4a76-b4d4-b299f154dc2d tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:08.029583 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d909f359-d259-4a76-b4d4-b299f154dc2d tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041595 Jul 20 14:25:08.030156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1607/3011] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:25:07 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 14:25:08.039903 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:08.040455 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:08.046767 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:08.047218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:08.047970 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:08.048502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:08.124490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] HTTP exception thrown: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e is not attached to volume 65f957fc-0ba7-4195-b1c5-70174ed72124 Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Request method failure captured: Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: DELETE /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments/65f957fc-0ba7-4195-b1c5-70174ed72124 HTTP/1.1 Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A_DsCE8L6OSl7OJC_qTHSVV-Crg4wC8poCPxs4GrK0QsfM_4-yXVILHK3ErLfGOnk65EVVtprP5rfpTzMOdKdCcLhpSCSXv-0EoKdLEgYm17DXcz6lauxaWgVlM5DLZkdkpqkDbNIrzM5SWzjARej4XnXhDJw-gZXRDbgmljiTDc4Q Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 97a2d5a2afb34be58295ddc1586e9a31 Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-TestMinimumBasicScenario-749372572 Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:25:08.126818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97a2d5a2afb34be58295ddc1586e9a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97a2d5a2afb34be58295ddc1586e9a31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97a2d5a2afb34be58295ddc1586e9a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97a2d5a2afb34be58295ddc1586e9a31"}]}] Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-TestMinimumBasicScenario-749372572 Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 97a2d5a2afb34be58295ddc1586e9a31 Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-TestMinimumBasicScenario-749372572 Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-TestMinimumBasicScenario-749372572-project Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: d58cfae576584be28b93f15976a411af Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-TestMinimumBasicScenario-749372572-project Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:25:08.129338 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e is not attached to volume 65f957fc-0ba7-4195-b1c5-70174ed72124 Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'server_id': 'bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e', 'id': '65f957fc-0ba7-4195-b1c5-70174ed72124'} Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 65f957fc-0ba7-4195-b1c5-70174ed72124. Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:25:08.130425 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e is not attached to volume 65f957fc-0ba7-4195-b1c5-70174ed72124 Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e is not attached to volume 65f957fc-0ba7-4195-b1c5-70174ed72124 Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:08.132128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Returning 404 to user: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e is not attached to volume 65f957fc-0ba7-4195-b1c5-70174ed72124 {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:25:08.133437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a835bfbf-2b75-456d-985d-3ddd9ea17ec1 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments/65f957fc-0ba7-4195-b1c5-70174ed72124" status: 404 len: 154 microversion: 2.1 time: 0.092845 Jul 20 14:25:08.133437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1405/3012] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 14:25:08 2022] DELETE /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e/os-volume_attachments/65f957fc-0ba7-4195-b1c5-70174ed72124 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:25:09.261161 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:09.261683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:09.267980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:09.268461 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:09.269217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:09.269653 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:09.292991 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:25:09.366784 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-beaf5486-7adb-4f25-b9f2-7cfea42bdf77 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 204 len: 0 microversion: 2.1 time: 0.109086 Jul 20 14:25:09.367286 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1608/3013] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:25:09 2022] DELETE /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:25:09.377134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:09.378325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:09.384852 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:09.385299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:09.386050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:09.386481 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:09.516105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:09.523711 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0eb1554a-93aa-4d77-a880-753d7f105684 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1555 microversion: 2.1 time: 0.151846 Jul 20 14:25:09.524286 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1406/3014] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:09 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:10.541476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:10.542158 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:10.548651 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:10.549103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:10.549893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:10.550333 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:10.676584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:10.684079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6dd28d7d-1312-4a29-be70-0471b5b9f70f tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1555 microversion: 2.1 time: 0.146919 Jul 20 14:25:10.684693 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1609/3015] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:10 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:11.701786 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:11.702410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:11.714396 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:11.714849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:11.715635 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:11.716104 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:11.782950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cfae576584be28b93f15976a411af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a2d5a2afb34be58295ddc1586e9a31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:11.790915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8c81e6bf-7458-4520-8373-2bd624f50eb7 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 200 len: 1513 microversion: 2.1 time: 0.092986 Jul 20 14:25:11.791502 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1407/3016] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:11 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 1513 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:11.992916 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-356ab0fd-6db4-4d6a-bf34-51564c468ceb req-3a7fedd9-a238-4df1-883c-7660ff9fa24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e", "name": "network-vif-deleted", "tag": "5942e44d-d688-4e13-b06a-43238c44b08d"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:12.003763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-356ab0fd-6db4-4d6a-bf34-51564c468ceb req-3a7fedd9-a238-4df1-883c-7660ff9fa24c service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:12.004239 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-356ab0fd-6db4-4d6a-bf34-51564c468ceb req-3a7fedd9-a238-4df1-883c-7660ff9fa24c service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:12.015025 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-356ab0fd-6db4-4d6a-bf34-51564c468ceb req-3a7fedd9-a238-4df1-883c-7660ff9fa24c service nova] Creating event network-vif-deleted:5942e44d-d688-4e13-b06a-43238c44b08d for instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e on hv-cinder-81914 Jul 20 14:25:12.020468 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-356ab0fd-6db4-4d6a-bf34-51564c468ceb req-3a7fedd9-a238-4df1-883c-7660ff9fa24c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Jul 20 14:25:12.021068 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1610/3017] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:12.808647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:12.809249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] [instance: bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:12.815170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:12.815614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:12.816394 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:12.816819 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:12.829443 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] HTTP exception thrown: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e could not be found. Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Request method failure captured: Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e HTTP/1.1 Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A_DsCE8L6OSl7OJC_qTHSVV-Crg4wC8poCPxs4GrK0QsfM_4-yXVILHK3ErLfGOnk65EVVtprP5rfpTzMOdKdCcLhpSCSXv-0EoKdLEgYm17DXcz6lauxaWgVlM5DLZkdkpqkDbNIrzM5SWzjARej4XnXhDJw-gZXRDbgmljiTDc4Q Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 97a2d5a2afb34be58295ddc1586e9a31 Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-TestMinimumBasicScenario-749372572 Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:25:12.830943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97a2d5a2afb34be58295ddc1586e9a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97a2d5a2afb34be58295ddc1586e9a31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97a2d5a2afb34be58295ddc1586e9a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97a2d5a2afb34be58295ddc1586e9a31"}]}] Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-TestMinimumBasicScenario-749372572 Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 97a2d5a2afb34be58295ddc1586e9a31 Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-TestMinimumBasicScenario-749372572 Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-TestMinimumBasicScenario-749372572-project Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: d58cfae576584be28b93f15976a411af Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-TestMinimumBasicScenario-749372572-project Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e could not be found. Jul 20 14:25:12.833063 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': 'bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e'} Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e could not be found. Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:25:12.834271 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e could not be found. Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e could not be found. Jul 20 14:25:12.836021 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:12.837574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Returning 404 to user: Instance bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:25:12.837574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ae8810b8-ceff-417a-8e4d-d94edd27aedf tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e" status: 404 len: 111 microversion: 2.1 time: 0.027852 Jul 20 14:25:12.837574 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1408/3018] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:12 2022] GET /compute/v2.1/servers/bf9f65c7-bcf4-4179-80cf-35a9bb38aa3e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:25:12.841525 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-47a5e625-7485-4368-a24e-523035e762e2 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] Calling method '.version_select at 0x7fa40d112160>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:12.858773 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-47a5e625-7485-4368-a24e-523035e762e2 tempest-TestMinimumBasicScenario-749372572 tempest-TestMinimumBasicScenario-749372572-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-881573416" status: 202 len: 0 microversion: 2.1 time: 0.021277 Jul 20 14:25:12.859319 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1611/3019] 10.222.0.17 () {58 vars in 1268 bytes} [Wed Jul 20 14:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-881573416 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:25:18.187937 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-57bc40a7-be1d-4ff6-a1f0-8007b9812f9e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:18.190251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-57bc40a7-be1d-4ff6-a1f0-8007b9812f9e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:18.197928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57bc40a7-be1d-4ff6-a1f0-8007b9812f9e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:18.198622 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57bc40a7-be1d-4ff6-a1f0-8007b9812f9e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:18.199385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57bc40a7-be1d-4ff6-a1f0-8007b9812f9e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:18.199814 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-57bc40a7-be1d-4ff6-a1f0-8007b9812f9e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:18.226784 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-57bc40a7-be1d-4ff6-a1f0-8007b9812f9e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/ips" status: 200 len: 151 microversion: 2.1 time: 0.043616 Jul 20 14:25:18.233150 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1409/3020] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 14:25:18 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:19.596604 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-7707598b-f27a-4de3-980a-0b5a1499a429 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c06383e4-9127-44e5-aed2-c96c9baa8b2f"}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:19.598881 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-7707598b-f27a-4de3-980a-0b5a1499a429 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:19.605943 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7707598b-f27a-4de3-980a-0b5a1499a429 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:19.606401 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7707598b-f27a-4de3-980a-0b5a1499a429 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:19.607217 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7707598b-f27a-4de3-980a-0b5a1499a429 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:19.607697 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-7707598b-f27a-4de3-980a-0b5a1499a429 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:19.881551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-7707598b-f27a-4de3-980a-0b5a1499a429 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292296 Jul 20 14:25:19.882867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1612/3021] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 14:25:19 2022] POST /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:26.334324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c06383e4-9127-44e5-aed2-c96c9baa8b2f"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:26.335423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:26.341902 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:26.342342 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:26.343094 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:26.343526 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:26.422291 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Invalid volume: volume c06383e4-9127-44e5-aed2-c96c9baa8b2f is already attached to instances: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: POST /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments HTTP/1.1 Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 74 Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:25:26.423892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {"volumeAttachment": {"volumeId": "c06383e4-9127-44e5-aed2-c96c9baa8b2f"}} Jul 20 14:25:26.426233 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Invalid volume: volume c06383e4-9127-44e5-aed2-c96c9baa8b2f is already attached to instances: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'server_id': '6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7', 'body': {'volumeAttachment': {'volumeId': 'c06383e4-9127-44e5-aed2-c96c9baa8b2f'}}} Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c06383e4-9127-44e5-aed2-c96c9baa8b2f is already attached to instances: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:26.427262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c06383e4-9127-44e5-aed2-c96c9baa8b2f is already attached to instances: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:26.428647 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c06383e4-9127-44e5-aed2-c96c9baa8b2f is already attached to instances: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 400 to user: Invalid volume: volume c06383e4-9127-44e5-aed2-c96c9baa8b2f is already attached to instances: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-1402e82b-efed-4a81-aea7-a3f60988e866 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095694 Jul 20 14:25:26.430092 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1410/3022] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 14:25:26 2022] POST /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 14:25:26.486167 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:26.486736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:26.493269 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:26.493713 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:26.494458 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:26.494884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:26.573800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lazy-loading 'services' on Instance uuid 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 14:25:26.647000 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-aef84a09-d6cc-4c18-b511-070a9175dd7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments/c06383e4-9127-44e5-aed2-c96c9baa8b2f" status: 202 len: 0 microversion: 2.1 time: 0.165249 Jul 20 14:25:26.647680 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1613/3023] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 14:25:26 2022] DELETE /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments/c06383e4-9127-44e5-aed2-c96c9baa8b2f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:25:26.655888 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c24e67ac-4422-498e-acb8-c03e3307fbb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:26.656823 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c24e67ac-4422-498e-acb8-c03e3307fbb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:26.663408 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c24e67ac-4422-498e-acb8-c03e3307fbb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:26.663921 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c24e67ac-4422-498e-acb8-c03e3307fbb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:26.664733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c24e67ac-4422-498e-acb8-c03e3307fbb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:26.665163 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c24e67ac-4422-498e-acb8-c03e3307fbb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:26.696613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c24e67ac-4422-498e-acb8-c03e3307fbb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Jul 20 14:25:26.697160 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1411/3024] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:25:26 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:27.710114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-379aa088-eec6-4b1a-b062-1aeefd7c1168 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:27.711206 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-379aa088-eec6-4b1a-b062-1aeefd7c1168 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:27.717492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-379aa088-eec6-4b1a-b062-1aeefd7c1168 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:27.717945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-379aa088-eec6-4b1a-b062-1aeefd7c1168 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:27.718706 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-379aa088-eec6-4b1a-b062-1aeefd7c1168 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:27.719143 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-379aa088-eec6-4b1a-b062-1aeefd7c1168 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:27.748058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-379aa088-eec6-4b1a-b062-1aeefd7c1168 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043590 Jul 20 14:25:27.748638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1614/3025] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:25:27 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 14:25:27.806748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:27.807253 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:27.813682 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:27.814134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:27.814901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:27.815336 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:27.840093 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Going to try to terminate instance {{(pid=129542) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:25:27.918441 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-0ba2badf-678a-454a-83f8-ca1f697b0650 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 204 len: 0 microversion: 2.1 time: 0.114373 Jul 20 14:25:27.919045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1412/3026] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:25:27 2022] DELETE /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:25:27.927753 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:27.928511 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:27.934480 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:27.934917 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:27.935668 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:27.936097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:28.064679 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:28.072554 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-dbe9ff0d-2452-49f8-8494-d7344b40ee55 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1682 microversion: 2.1 time: 0.149165 Jul 20 14:25:28.073118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1615/3027] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:27 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:25:29.091144 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:29.091847 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:29.098499 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:29.098976 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:29.099871 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:29.100218 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:29.233156 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:29.241079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3d6715b1-62a4-481e-96bc-5b428e3950a0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1682 microversion: 2.1 time: 0.154305 Jul 20 14:25:29.241645 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1413/3028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:29 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:30.259037 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:30.259639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:30.266341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:30.266790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:30.267559 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:30.268073 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:30.365587 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:30.374763 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9a502534-fc36-4393-8755-cdde8eb382a1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 200 len: 1615 microversion: 2.1 time: 0.119606 Jul 20 14:25:30.375570 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1616/3029] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:30 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 1615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:30.543907 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-fe86bc83-492a-4e06-88cf-4b4ba2eeb4be req-b8858e97-4a41-41ec-8c00-6b300a95bc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7", "name": "network-vif-deleted", "tag": "0bc1e5fb-f036-4321-b33d-0c36c01cd574"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:30.555324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-fe86bc83-492a-4e06-88cf-4b4ba2eeb4be req-b8858e97-4a41-41ec-8c00-6b300a95bc1f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:30.555831 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-fe86bc83-492a-4e06-88cf-4b4ba2eeb4be req-b8858e97-4a41-41ec-8c00-6b300a95bc1f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:30.568987 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-fe86bc83-492a-4e06-88cf-4b4ba2eeb4be req-b8858e97-4a41-41ec-8c00-6b300a95bc1f service nova] Creating event network-vif-deleted:0bc1e5fb-f036-4321-b33d-0c36c01cd574 for instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 on hv-cinder-81914 Jul 20 14:25:30.575116 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-fe86bc83-492a-4e06-88cf-4b4ba2eeb4be req-b8858e97-4a41-41ec-8c00-6b300a95bc1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035832 Jul 20 14:25:30.576003 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1414/3030] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:31.392500 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:31.393137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:31.399984 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:31.400479 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:31.401249 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:31.401683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:31.418446 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 HTTP/1.1 Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:25:31.420608 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:25:31.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7'} Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:25:31.423576 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:25:31.426015 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:25:31.427564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:25:31.427564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-ea2072fc-3641-4423-bdb5-3f34005f1e75 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 404 len: 111 microversion: 2.1 time: 0.033586 Jul 20 14:25:31.427564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1617/3031] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:31 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:25:31.434724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-5642d712-3389-4211-b268-6d543ccc3c7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '.version_select at 0x7fa411a0b9d0>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:31.455209 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-5642d712-3389-4211-b268-6d543ccc3c7c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558179539" status: 202 len: 0 microversion: 2.1 time: 0.024926 Jul 20 14:25:31.456034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1415/3032] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jul 20 14:25:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558179539 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:25:32.067508 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2b431f49-43b9-4966-a00a-441d624d6c42 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: .version_select at 0x7fa40e71e0d0>, body: {"keypair": {"name": "tempest-keypair-876723363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYFxtMkjvWvTWFnMY2zhfOgAD+3GzKCu8Gyt8ANT15d/0fMv61up7Ot/J5jVjb8v4QjQPDXg6wzHCdIbtJk3lDLiqk8vnLTAWSgLI3dvgaVp9N/bnyTPgYAzfyefemWqg=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:32.081123 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-2b431f49-43b9-4966-a00a-441d624d6c42 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:25:32.085178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-2b431f49-43b9-4966-a00a-441d624d6c42 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:25:32.106663 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2b431f49-43b9-4966-a00a-441d624d6c42 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042974 Jul 20 14:25:32.107275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1618/3033] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 14:25:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:33.387340 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-443956898", "imageRef": "072fb23f-78ed-479c-8137-a80c4fd801e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580d7049-af6d-4b21-b8f2-9a9533276a21"}], "security_groups": [{"name": "tempest-securitygroup--381498007"}], "key_name": "tempest-keypair-876723363", "user_data": "}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:33.489260 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] validate_networks() for [('580d7049-af6d-4b21-b8f2-9a9533276a21', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:25:33.858329 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:25:33.858764 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:25:33.859230 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:25:33.859624 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:25:33.860027 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:25:33.868735 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:33.869174 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:33.869949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:33.870373 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:33.886296 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:25:33.890061 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Getting quotas for user c2aa9f2c386647998cff8688be616660 and project f2321a0eb5ea4a99864bcbff6365d538. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:25:33.901110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:25:33.903383 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='072fb23f-78ed-479c-8137-a80c4fd801e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:25:33.949314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a810061f-4703-4642-bef0-0302373d9569 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.566651 Jul 20 14:25:33.949950 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1416/3034] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:25:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:25:33.960732 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-0242df7e-69b2-4018-9759-8a28d4f71b8c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:33.961330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-0242df7e-69b2-4018-9759-8a28d4f71b8c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:34.021498 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-0242df7e-69b2-4018-9759-8a28d4f71b8c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:34.028575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-0242df7e-69b2-4018-9759-8a28d4f71b8c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1240 microversion: 2.1 time: 0.072606 Jul 20 14:25:34.029139 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1619/3035] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:33 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:35.045325 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:35.045953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:35.053005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:35.053445 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:35.054217 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:35.054629 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:35.121583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:35.129449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b629553d-31ce-4add-a19d-cf80725be87e tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1298 microversion: 2.1 time: 0.087925 Jul 20 14:25:35.130008 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1417/3036] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:35 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:36.146799 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:36.147402 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:36.149864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:36.155277 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:36.155726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:36.156527 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:36.156961 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:36.162567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:36.225968 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-8a8e59ec-f3d0-46ae-a405-ff066f4afb61 req-f82099f9-75b3-4607-994d-5c9db8386ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4468b68c-8b4a-43ae-85a3-5d50688577bc", "tag": "faab76a5-ce0b-4bc7-a441-a1505df4edb6"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:36.240395 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-8a8e59ec-f3d0-46ae-a405-ff066f4afb61 req-f82099f9-75b3-4607-994d-5c9db8386ce8 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:36.241288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-8a8e59ec-f3d0-46ae-a405-ff066f4afb61 req-f82099f9-75b3-4607-994d-5c9db8386ce8 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:36.246560 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:36.258097 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-8a8e59ec-f3d0-46ae-a405-ff066f4afb61 req-f82099f9-75b3-4607-994d-5c9db8386ce8 service nova] Creating event network-changed:faab76a5-ce0b-4bc7-a441-a1505df4edb6 for instance 4468b68c-8b4a-43ae-85a3-5d50688577bc on hv-cinder-81914 Jul 20 14:25:36.264025 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-8a8e59ec-f3d0-46ae-a405-ff066f4afb61 req-f82099f9-75b3-4607-994d-5c9db8386ce8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043015 Jul 20 14:25:36.264826 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1418/3037] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:36.439802 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:36.451069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8ac0d9dc-f36d-4c4d-bb49-7295980536ce tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1365 microversion: 2.1 time: 0.308367 Jul 20 14:25:36.461264 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1620/3038] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:36 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:37.470186 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:37.471011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:37.472909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:37.478913 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:37.479357 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:37.480115 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:37.480579 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:37.610262 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:37.618166 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4dcc7197-da2e-4c12-bbae-7b78520b0fcf tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1365 microversion: 2.1 time: 0.152995 Jul 20 14:25:37.618723 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1419/3039] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:37 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:38.635403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:38.636178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:38.642646 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:38.643097 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:38.643864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:38.644358 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:38.775654 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:38.782945 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9ae3906f-d5a4-4d8a-8c50-22033486beac tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1365 microversion: 2.1 time: 0.151492 Jul 20 14:25:38.783506 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1621/3040] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:38 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:39.800729 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:39.801953 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:39.808939 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:39.809391 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:39.810158 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:39.810613 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:39.937717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:39.945134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-cefb1816-d0e9-4d15-8589-05adbb5d18b0 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1365 microversion: 2.1 time: 0.149484 Jul 20 14:25:39.945690 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1420/3041] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:39 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:40.961326 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:40.961933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:40.968491 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:40.968938 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:40.969691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:40.970124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:41.094056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:41.101895 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a039d4aa-a821-49d6-9df8-f86a3eb78e77 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1365 microversion: 2.1 time: 0.144434 Jul 20 14:25:41.103012 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1622/3042] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:40 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:41.456317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-f4aba7e1-98f6-479e-96d0-fc49fa822b1c req-fbb81e88-6c9c-4b3e-8714-d2bb40ea3408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4468b68c-8b4a-43ae-85a3-5d50688577bc", "name": "network-vif-plugged", "status": "completed", "tag": "faab76a5-ce0b-4bc7-a441-a1505df4edb6"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:41.467300 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f4aba7e1-98f6-479e-96d0-fc49fa822b1c req-fbb81e88-6c9c-4b3e-8714-d2bb40ea3408 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:41.467746 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-f4aba7e1-98f6-479e-96d0-fc49fa822b1c req-fbb81e88-6c9c-4b3e-8714-d2bb40ea3408 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:41.482079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-f4aba7e1-98f6-479e-96d0-fc49fa822b1c req-fbb81e88-6c9c-4b3e-8714-d2bb40ea3408 service nova] Creating event network-vif-plugged:faab76a5-ce0b-4bc7-a441-a1505df4edb6 for instance 4468b68c-8b4a-43ae-85a3-5d50688577bc on hv-cinder-81914 Jul 20 14:25:41.486838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-f4aba7e1-98f6-479e-96d0-fc49fa822b1c req-fbb81e88-6c9c-4b3e-8714-d2bb40ea3408 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Jul 20 14:25:41.487838 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1421/3043] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:42.118592 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:42.119201 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:42.125790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:42.126237 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:42.126998 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:42.127437 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:42.254381 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:42.261695 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-37b87115-2715-4092-945f-54c962e9aa79 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1365 microversion: 2.1 time: 0.147078 Jul 20 14:25:42.262254 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1623/3044] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:42 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:43.279368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:43.280108 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:43.287005 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:43.287471 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:43.288267 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:43.288701 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:43.423089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:25:43.431322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-879d4cd9-c410-44b2-adbb-318be6e73412 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1556 microversion: 2.1 time: 0.156689 Jul 20 14:25:43.431894 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1422/3045] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:25:43 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:25:43.447351 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a2f98e19-e84b-4ff7-b111-f199428fb7e9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:25:43.447834 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a2f98e19-e84b-4ff7-b111-f199428fb7e9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:25:43.454334 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2f98e19-e84b-4ff7-b111-f199428fb7e9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:43.454781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2f98e19-e84b-4ff7-b111-f199428fb7e9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:43.455550 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2f98e19-e84b-4ff7-b111-f199428fb7e9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:43.455986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a2f98e19-e84b-4ff7-b111-f199428fb7e9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:43.530655 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a2f98e19-e84b-4ff7-b111-f199428fb7e9 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087141 Jul 20 14:25:43.531252 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1624/3046] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jul 20 14:25:43 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:25:44.697895 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-921741d7-18db-492d-9341-7219fe018806 req-4224c400-947a-43ea-b59b-e36cb088eb48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4468b68c-8b4a-43ae-85a3-5d50688577bc", "tag": "faab76a5-ce0b-4bc7-a441-a1505df4edb6"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:25:44.701759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:44.702427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:44.709653 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-921741d7-18db-492d-9341-7219fe018806 req-4224c400-947a-43ea-b59b-e36cb088eb48 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:25:44.710088 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-921741d7-18db-492d-9341-7219fe018806 req-4224c400-947a-43ea-b59b-e36cb088eb48 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:25:44.720667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-921741d7-18db-492d-9341-7219fe018806 req-4224c400-947a-43ea-b59b-e36cb088eb48 service nova] Creating event network-changed:faab76a5-ce0b-4bc7-a441-a1505df4edb6 for instance 4468b68c-8b4a-43ae-85a3-5d50688577bc on hv-cinder-81914 Jul 20 14:25:44.725688 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-921741d7-18db-492d-9341-7219fe018806 req-4224c400-947a-43ea-b59b-e36cb088eb48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031338 Jul 20 14:25:44.726643 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1423/3047] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:26:20.864580 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=6 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:20.866728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=9 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:20.867567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=27 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:20.872094 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-af3f4485-f5f9-4978-851e-1d1c524d7bdb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:20.872639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-af3f4485-f5f9-4978-851e-1d1c524d7bdb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:20.880448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af3f4485-f5f9-4978-851e-1d1c524d7bdb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:20.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af3f4485-f5f9-4978-851e-1d1c524d7bdb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:20.881667 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af3f4485-f5f9-4978-851e-1d1c524d7bdb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:20.882103 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-af3f4485-f5f9-4978-851e-1d1c524d7bdb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:20.904539 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-af3f4485-f5f9-4978-851e-1d1c524d7bdb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/ips" status: 200 len: 151 microversion: 2.1 time: 0.040683 Jul 20 14:26:20.905102 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1625/3048] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jul 20 14:26:20 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:26:22.221371 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-73570dae-c876-42c7-ae81-e6fefde6731b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "320b3afd-1a7d-4281-82c2-04a26e23c241"}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:26:22.223029 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-73570dae-c876-42c7-ae81-e6fefde6731b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:22.225236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=9 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:22.225972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=23 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:22.232288 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73570dae-c876-42c7-ae81-e6fefde6731b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:22.232736 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73570dae-c876-42c7-ae81-e6fefde6731b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:22.233497 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73570dae-c876-42c7-ae81-e6fefde6731b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:22.233927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73570dae-c876-42c7-ae81-e6fefde6731b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:22.462766 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-73570dae-c876-42c7-ae81-e6fefde6731b tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "POST /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245553 Jul 20 14:26:22.463437 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1424/3049] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jul 20 14:26:22 2022] POST /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:26:28.985049 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:28.985557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:28.992542 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:28.992995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:28.993758 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:28.994191 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:29.071457 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.objects.instance [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lazy-loading 'services' on Instance uuid 4468b68c-8b4a-43ae-85a3-5d50688577bc {{(pid=129541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 14:26:29.140967 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1e4d97a0-9ef6-47bb-af67-f94e3191bcb4 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments/320b3afd-1a7d-4281-82c2-04a26e23c241" status: 202 len: 0 microversion: 2.1 time: 0.159706 Jul 20 14:26:29.141564 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1626/3050] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jul 20 14:26:28 2022] DELETE /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments/320b3afd-1a7d-4281-82c2-04a26e23c241 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:26:29.154440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7dd164ca-1403-4b9f-b000-0f3e23195ea6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:29.155447 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-7dd164ca-1403-4b9f-b000-0f3e23195ea6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:29.162012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7dd164ca-1403-4b9f-b000-0f3e23195ea6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:29.162457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7dd164ca-1403-4b9f-b000-0f3e23195ea6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:29.163226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7dd164ca-1403-4b9f-b000-0f3e23195ea6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:29.163654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-7dd164ca-1403-4b9f-b000-0f3e23195ea6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:29.195276 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7dd164ca-1403-4b9f-b000-0f3e23195ea6 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049110 Jul 20 14:26:29.195840 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1425/3051] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:26:29 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:26:30.208159 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1605f05c-9a5d-4baf-9cb1-cf09d1504207 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:30.209242 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1605f05c-9a5d-4baf-9cb1-cf09d1504207 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:30.215330 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1605f05c-9a5d-4baf-9cb1-cf09d1504207 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:30.215770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1605f05c-9a5d-4baf-9cb1-cf09d1504207 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:30.216552 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1605f05c-9a5d-4baf-9cb1-cf09d1504207 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:30.216980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1605f05c-9a5d-4baf-9cb1-cf09d1504207 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:30.246488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1605f05c-9a5d-4baf-9cb1-cf09d1504207 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043343 Jul 20 14:26:30.247038 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1627/3052] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jul 20 14:26:30 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 14:26:30.304023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:30.304552 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:30.310944 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:30.311392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:30.312139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:30.312611 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:30.336668 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Going to try to terminate instance {{(pid=129542) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:26:30.411600 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-83e13f83-dab9-4412-8f42-1d9d15c70703 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 204 len: 0 microversion: 2.1 time: 0.111767 Jul 20 14:26:30.412285 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1426/3053] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:26:30 2022] DELETE /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:26:30.420509 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:30.421114 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:30.427085 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:30.427532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:30.428325 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:30.428755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:30.563467 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:26:30.570913 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-430746f6-87c4-4574-81be-37ca836bd723 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1681 microversion: 2.1 time: 0.154208 Jul 20 14:26:30.571472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1628/3054] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:30 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:26:31.588616 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:31.589346 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:31.595706 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:31.596152 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:31.597477 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:31.598032 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:31.731943 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:26:31.740030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-34fd8b26-836a-497a-98bb-bf295c22feb1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1681 microversion: 2.1 time: 0.155636 Jul 20 14:26:31.740625 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1427/3055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:31 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:26:32.740463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-22c2a0b6-de11-43e8-91e6-b69a6e012373 req-07b0d847-1185-46cf-8dac-56b20ae0fd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4468b68c-8b4a-43ae-85a3-5d50688577bc", "name": "network-vif-deleted", "tag": "faab76a5-ce0b-4bc7-a441-a1505df4edb6"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:26:32.749594 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-22c2a0b6-de11-43e8-91e6-b69a6e012373 req-07b0d847-1185-46cf-8dac-56b20ae0fd94 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:32.750039 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-22c2a0b6-de11-43e8-91e6-b69a6e012373 req-07b0d847-1185-46cf-8dac-56b20ae0fd94 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:32.757173 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:32.763607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-22c2a0b6-de11-43e8-91e6-b69a6e012373 req-07b0d847-1185-46cf-8dac-56b20ae0fd94 service nova] Creating event network-vif-deleted:faab76a5-ce0b-4bc7-a441-a1505df4edb6 for instance 4468b68c-8b4a-43ae-85a3-5d50688577bc on hv-cinder-81914 Jul 20 14:26:32.764547 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:32.768666 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-22c2a0b6-de11-43e8-91e6-b69a6e012373 req-07b0d847-1185-46cf-8dac-56b20ae0fd94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031834 Jul 20 14:26:32.769144 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1629/3056] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:26:32.778236 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:32.780287 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:32.781138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:32.781822 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:32.855859 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9f2c386647998cff8688be616660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2321a0eb5ea4a99864bcbff6365d538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:26:32.864520 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d3018f82-1d3b-4a59-bf9e-ec5ac204c027 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 200 len: 1325 microversion: 2.1 time: 0.110897 Jul 20 14:26:32.865392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1428/3057] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:32 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 1325 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:26:33.881954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:33.882641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:33.888877 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:33.889327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:33.890079 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:33.890510 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:33.904683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc HTTP/1.1 Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:26:33.906265 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:33.908304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '4468b68c-8b4a-43ae-85a3-5d50688577bc'} Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:33.909448 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:33.911772 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:33.913432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:33.913432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-38997b10-d590-45e5-84aa-67aa872d0a6c tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 404 len: 111 microversion: 2.1 time: 0.030382 Jul 20 14:26:33.913432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1630/3058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:33 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:26:33.916762 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-7225a45e-fb50-43b7-a1e1-b3df0340cddb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '.version_select at 0x7fa40d2b0a60>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:33.934188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-7225a45e-fb50-43b7-a1e1-b3df0340cddb tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876723363" status: 202 len: 0 microversion: 2.1 time: 0.021147 Jul 20 14:26:33.934739 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1429/3059] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jul 20 14:26:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876723363 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 14:26:35.665335 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:35.665848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:35.672283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:35.672728 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:35.673476 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:35.673907 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:35.686923 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc HTTP/1.1 Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:26:35.688473 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.690251 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '4468b68c-8b4a-43ae-85a3-5d50688577bc'} Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:35.691283 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.692995 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.694661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:35.694661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e0dcc193-5902-4ebd-8bd8-b7c8c5444940 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 404 len: 111 microversion: 2.1 time: 0.028307 Jul 20 14:26:35.694661 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1631/3060] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:26:35 2022] DELETE /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 14:26:35.698411 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:35.699020 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 4468b68c-8b4a-43ae-85a3-5d50688577bc] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:35.705988 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:35.706694 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:35.707945 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:35.708427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:35.721172 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc HTTP/1.1 Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:26:35.723464 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.725299 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '4468b68c-8b4a-43ae-85a3-5d50688577bc'} Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:35.726317 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. Jul 20 14:26:35.727972 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:35.729511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 4468b68c-8b4a-43ae-85a3-5d50688577bc could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:35.729511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-870934db-0c63-4db4-9c10-b1e779a31d80 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc" status: 404 len: 111 microversion: 2.1 time: 0.030395 Jul 20 14:26:35.729511 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1430/3061] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:35 2022] GET /compute/v2.1/servers/4468b68c-8b4a-43ae-85a3-5d50688577bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:26:36.856726 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:36.857224 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:36.864223 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.864682 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.865445 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.865880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.879306 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 HTTP/1.1 Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:26:36.880897 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.882702 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7'} Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:36.883727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.885426 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.887216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:36.887216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f50e8185-361b-4ab9-adad-41de9220a0e1 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 404 len: 111 microversion: 2.1 time: 0.029543 Jul 20 14:26:36.887216 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1632/3062] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:26:36 2022] DELETE /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:26:36.890759 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:36.891488 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:36.897971 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.898413 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.899161 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.899591 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.913368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 HTTP/1.1 Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:26:36.915275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.918470 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7'} Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:36.919465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. Jul 20 14:26:36.921050 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.922382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:36.922382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-3fa88c82-9e7b-47d4-9827-8c888adf19d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7" status: 404 len: 111 microversion: 2.1 time: 0.029350 Jul 20 14:26:36.922382 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1431/3063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:36 2022] GET /compute/v2.1/servers/6a6782a6-8bda-4e68-ab4a-5f78bdec3fc7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:26:36.926403 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:36.926898 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:36.932940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.933391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.934154 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.934590 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.947736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 HTTP/1.1 Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:26:36.949295 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.951074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': 'd7ed4503-6e54-4006-85f5-53d06bdcf357'} Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:36.952124 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.953800 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.955533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:36.955533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f4bd302c-7143-494e-9648-e0f0fe7feff7 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 404 len: 111 microversion: 2.1 time: 0.028761 Jul 20 14:26:36.955533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1633/3064] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:26:36 2022] DELETE /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:26:36.959098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:36.959697 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: d7ed4503-6e54-4006-85f5-53d06bdcf357] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:36.965683 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.966120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.966866 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:36.967294 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:36.980679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 HTTP/1.1 Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:26:36.982157 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.984024 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': 'd7ed4503-6e54-4006-85f5-53d06bdcf357'} Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:36.985079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. Jul 20 14:26:36.986717 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:36.988389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance d7ed4503-6e54-4006-85f5-53d06bdcf357 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:36.988389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-fce51b97-c490-4108-a2d5-38667b93cc1a tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357" status: 404 len: 111 microversion: 2.1 time: 0.028387 Jul 20 14:26:36.988389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1432/3065] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:36 2022] GET /compute/v2.1/servers/d7ed4503-6e54-4006-85f5-53d06bdcf357 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 14:26:38.114781 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:38.115270 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:38.121567 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:38.122041 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:38.122789 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:38.123213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:38.136888 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.wsgi [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: request: DELETE /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 HTTP/1.1 Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept: application/json Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Accept-Encoding: identity Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Connection: close Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Length: 0 Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Content-Type: application/json Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Host: 10.222.0.17 Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Openstack-System-Scope: None Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Id: None Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Domain-Name: None Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Identity-Status: Confirmed Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Is-Admin-Project: True Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Id: default Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Domain-Name: Default Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Role: member,reader Jul 20 14:26:38.138414 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Roles: member,reader Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Id: default Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Domain-Name: Default Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: method: > Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: exception: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.140178 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: action_args: {'id': '6eff9203-42ca-4546-8001-e230845451e6'} Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:38.141180 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.142617 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.144122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. {{(pid=129541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:38.144122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5b31ba18-731e-4e7d-afd9-20f61584e5d8 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 404 len: 111 microversion: 2.1 time: 0.029403 Jul 20 14:26:38.144122 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1634/3066] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:26:38 2022] DELETE /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:26:38.148105 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:26:38.148740 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] [instance: 6eff9203-42ca-4546-8001-e230845451e6] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:26:38.155120 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:38.155569 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:38.156361 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:26:38.156801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:26:38.169837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] HTTP exception thrown: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Request method failure captured: Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 HTTP/1.1 Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2A-FuAflaMKjjW6LXiN8QQrizKxrGZSqPAb5GOrLnatBWX893JA6HQ375cvP0iCHKryYKpa6Xvw56zY6mH6MFZV_crPNiA4vjDgTLoK4WS96Tq0MOD9gjLtPUsRytS7r9TCnlhJqBc-_kPBeypWj8L2V9ylP9fT1VYqhKZHTgpLVTCA Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:26:38.171322 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2321a0eb5ea4a99864bcbff6365d538"}]}] Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: f2321a0eb5ea4a99864bcbff6365d538 Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271197933 Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: c2aa9f2c386647998cff8688be616660 Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-AttachVolumeNegativeTest-1271197933-project Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.173127 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '6eff9203-42ca-4546-8001-e230845451e6'} Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:26:38.174353 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. Jul 20 14:26:38.176517 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:26:38.178183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] Returning 404 to user: Instance 6eff9203-42ca-4546-8001-e230845451e6 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:26:38.178183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-38afd6e9-c749-4b0e-9498-56e76cc8aa90 tempest-AttachVolumeNegativeTest-1271197933 tempest-AttachVolumeNegativeTest-1271197933-project] 10.222.0.17 "GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6" status: 404 len: 111 microversion: 2.1 time: 0.028430 Jul 20 14:26:38.178183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1433/3067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:26:38 2022] GET /compute/v2.1/servers/6eff9203-42ca-4546-8001-e230845451e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:27:13.833520 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:27:13.834519 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:27:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:27:54.898303 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=20 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:54.899074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:55.108227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-16f1deda-c138-45ca-b4a0-5d4becc374b9 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Action: 'create', calling method: .version_select at 0x7fa40d19f430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1122089618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXJUdCjRWI08K9eblROILYUcCBAw6HvuygcfH9d+MgV2q9r3UlplfUDbGIG9mVb3XdNj2KxHyJ4hJ3UbVPRO2vRci+vjzTUp5+PakvehlVQwENdexhXjWD+6xDqSh/8Lg=="}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:27:55.123192 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-16f1deda-c138-45ca-b4a0-5d4becc374b9 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Getting quotas for project 4c581a98139043aea10590f609772f5f. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:27:55.131878 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-16f1deda-c138-45ca-b4a0-5d4becc374b9 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Getting quotas for user 19108692061f4d73a085081d39d0f547 and project 4c581a98139043aea10590f609772f5f. Resources: {'key_pairs'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:27:55.156738 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-16f1deda-c138-45ca-b4a0-5d4becc374b9 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.260094 Jul 20 14:27:55.157551 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1635/3068] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jul 20 14:27:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:28:12.495393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:12.496159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:12.500226 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-302716092", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1122089618", "security_groups": [{"name": "tempest-secgroup-smoke-344139019"}], "block_device_mapping_v2": [{"uuid": "475d0fc3-718c-4774-9200-555f7bcd0e5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daa9f12b-0276-4a15-a781-c9be024bf6c1"}]}} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:28:12.743904 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.network.neutron [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] validate_networks() for [('daa9f12b-0276-4a15-a781-c9be024bf6c1', None, None, None, None, None)] {{(pid=129542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:28:13.200307 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Flavor limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:28:13.200724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Image limits 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:28:13.201188 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Flavor pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:28:13.201610 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Image pref 0:0:0 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:28:13.202011 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.virt.hardware [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:28:13.211327 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:13.211770 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:13.212593 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:13.213023 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:13.229272 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Getting quotas for project 4c581a98139043aea10590f609772f5f. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:28:13.233200 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.quota [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Getting quotas for user 19108692061f4d73a085081d39d0f547 and project 4c581a98139043aea10590f609772f5f. Resources: {'ram', 'instances', 'cores'} {{(pid=129542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:28:13.292475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Going to run 1 instances... {{(pid=129542) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:28:13.294748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='475d0fc3-718c-4774-9200-555f7bcd0e5f',volume_size=None,volume_type=None)] {{(pid=129542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:28:13.419803 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8f52ce80-dcb0-4034-8ddf-519503d2f57e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.926157 Jul 20 14:28:13.420531 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1434/3069] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:28:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:28:13.428659 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=4 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:13.429391 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:13.433925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-96993435-2362-43cf-acfb-2f1a9fd69d9e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:13.434474 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-96993435-2362-43cf-acfb-2f1a9fd69d9e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:13.550620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-96993435-2362-43cf-acfb-2f1a9fd69d9e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:13.557074 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-96993435-2362-43cf-acfb-2f1a9fd69d9e tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1094 microversion: 2.1 time: 0.129849 Jul 20 14:28:13.557631 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1636/3070] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:13 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1094 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:14.575804 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:14.577129 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:14.585071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:14.585863 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:14.586648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:14.587089 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:14.657824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:14.665936 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-af3c08c7-ea9b-4f69-9f32-4768fbce3756 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1210 microversion: 2.1 time: 0.095305 Jul 20 14:28:14.666521 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1435/3071] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:14 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:15.682909 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:15.683517 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:15.690859 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:15.691321 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:15.692110 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:15.692579 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:15.894830 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:15.902851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6f808126-902e-4cf6-8451-ed05f153f7e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.223787 Jul 20 14:28:15.903581 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1637/3072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:15 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:15.962695 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-ba145220-9b20-4588-9c3d-808ccf4aac06 req-706717af-dd28-4ef7-a1b0-e413ee5925d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103db46f-9fbe-47a3-97f7-c64229d266a8", "tag": "6ebed62b-80ba-4cad-aa82-7c340d5c0572"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:28:15.974867 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-ba145220-9b20-4588-9c3d-808ccf4aac06 req-706717af-dd28-4ef7-a1b0-e413ee5925d3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:15.975315 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-ba145220-9b20-4588-9c3d-808ccf4aac06 req-706717af-dd28-4ef7-a1b0-e413ee5925d3 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:15.990892 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-ba145220-9b20-4588-9c3d-808ccf4aac06 req-706717af-dd28-4ef7-a1b0-e413ee5925d3 service nova] Creating event network-changed:6ebed62b-80ba-4cad-aa82-7c340d5c0572 for instance 103db46f-9fbe-47a3-97f7-c64229d266a8 on hv-cinder-81914 Jul 20 14:28:15.996724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-ba145220-9b20-4588-9c3d-808ccf4aac06 req-706717af-dd28-4ef7-a1b0-e413ee5925d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037396 Jul 20 14:28:15.997542 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1436/3073] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:28:16.920990 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:16.921880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:16.929119 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:16.929574 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:16.930346 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:16.930783 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:17.147362 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:17.155312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-f42dfed7-d2c6-43c0-871c-162edbf0514d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.238136 Jul 20 14:28:17.155884 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1638/3074] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:16 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:18.174034 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:18.174748 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:18.180872 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:18.181314 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:18.182067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:18.182496 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:18.315754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:18.323111 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-d4d7cc2a-8eca-44c3-812e-960256ad4593 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.153817 Jul 20 14:28:18.323674 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1437/3075] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:18 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:19.340221 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:19.340831 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:19.347423 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:19.347864 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:19.348639 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:19.349069 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:19.481061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:19.488872 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-2729bb0a-6208-4305-ae0a-f45ee8e08a91 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.152510 Jul 20 14:28:19.489432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1639/3076] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:19 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:20.505665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:20.506274 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:20.512820 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:20.513269 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:20.514030 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:20.514466 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:20.652427 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:20.660558 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-52b60eee-41c8-4288-a8e7-57323aa9836b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.158697 Jul 20 14:28:20.661106 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1438/3077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:20 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:21.677213 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:21.677837 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:21.684310 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:21.684750 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:21.685507 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:21.685933 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:21.822788 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:21.830925 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-844399d4-8e2a-4a73-a67e-b5a3cd71fe4b tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.156946 Jul 20 14:28:21.831486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1640/3078] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:21 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:22.847754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:22.848385 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:22.855037 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:22.855468 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:22.856251 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:22.856679 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:22.988908 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:22.996813 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-37252457-e744-46d4-89ac-eed8e23a08df tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.153175 Jul 20 14:28:22.997389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1439/3079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:22 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:24.014770 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:24.015141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:24.017883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:24.023456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:24.023906 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:24.024704 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:24.025141 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:24.160947 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:24.168547 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-5d7e7380-aebe-4b57-9fbc-4f4877e218c6 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.157835 Jul 20 14:28:24.169226 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1641/3080] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:24 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:25.186258 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:25.186882 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:25.188849 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=2 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:25.190012 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=6 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:25.196556 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:25.196996 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:25.197754 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:25.198184 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:25.332142 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:25.339432 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8edfc48b-9f5f-48e2-ac0f-c28fc7a6f387 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.156990 Jul 20 14:28:25.339995 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1440/3081] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:25 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:26.285341 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-2d301328-9d51-40de-b1cb-dbe6654dfa75 req-bf459f26-fdfc-4644-8eea-ba71c37260fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103db46f-9fbe-47a3-97f7-c64229d266a8", "name": "network-vif-plugged", "status": "completed", "tag": "6ebed62b-80ba-4cad-aa82-7c340d5c0572"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:28:26.294138 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-2d301328-9d51-40de-b1cb-dbe6654dfa75 req-bf459f26-fdfc-4644-8eea-ba71c37260fd service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:26.294614 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-2d301328-9d51-40de-b1cb-dbe6654dfa75 req-bf459f26-fdfc-4644-8eea-ba71c37260fd service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:26.306721 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-2d301328-9d51-40de-b1cb-dbe6654dfa75 req-bf459f26-fdfc-4644-8eea-ba71c37260fd service nova] Creating event network-vif-plugged:6ebed62b-80ba-4cad-aa82-7c340d5c0572 for instance 103db46f-9fbe-47a3-97f7-c64229d266a8 on hv-cinder-81914 Jul 20 14:28:26.311727 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-2d301328-9d51-40de-b1cb-dbe6654dfa75 req-bf459f26-fdfc-4644-8eea-ba71c37260fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087902 Jul 20 14:28:26.312327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1642/3082] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:28:26.356324 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:26.356923 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:26.364178 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:26.364641 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:26.365392 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:26.365818 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:26.499743 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:26.507219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-4c7b7124-70bb-417c-a3ee-e0d79b12af3a tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.154870 Jul 20 14:28:26.507792 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1441/3083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:26 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:27.527978 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:27.528596 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:27.534796 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:27.535246 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:27.536005 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:27.536472 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:27.668387 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:27.676642 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-71a74fab-8f1d-4acf-9a8c-04fbd7910e3f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1265 microversion: 2.1 time: 0.155845 Jul 20 14:28:27.677193 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1643/3084] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:27 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:28.699648 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:28.700280 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:28.707848 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:28.708349 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:28.709141 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:28.709576 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:28.844890 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:28.853031 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f0c8773a-c655-4f96-83df-7e2ee90e006f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1452 microversion: 2.1 time: 0.158572 Jul 20 14:28:28.853602 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1442/3085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:28 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:28.869829 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:28:28.870428 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:28:28.876842 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:28.877287 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:28.878055 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:28.878524 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:29.015398 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:28:29.025222 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6b881a71-8924-4017-b236-c0e23d0d4011 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1452 microversion: 2.1 time: 0.159224 Jul 20 14:28:29.025787 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1644/3086] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:28:28 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:28:30.657837 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-5b8ef823-5bf6-4080-b161-22d89b9c7d0a req-5672cf0a-7fca-44fc-b295-5569dc872b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103db46f-9fbe-47a3-97f7-c64229d266a8", "tag": "6ebed62b-80ba-4cad-aa82-7c340d5c0572"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:28:30.666487 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-5b8ef823-5bf6-4080-b161-22d89b9c7d0a req-5672cf0a-7fca-44fc-b295-5569dc872b5a service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:28:30.666930 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-5b8ef823-5bf6-4080-b161-22d89b9c7d0a req-5672cf0a-7fca-44fc-b295-5569dc872b5a service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:28:30.679964 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-5b8ef823-5bf6-4080-b161-22d89b9c7d0a req-5672cf0a-7fca-44fc-b295-5569dc872b5a service nova] Creating event network-changed:6ebed62b-80ba-4cad-aa82-7c340d5c0572 for instance 103db46f-9fbe-47a3-97f7-c64229d266a8 on hv-cinder-81914 Jul 20 14:28:30.685134 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-5b8ef823-5bf6-4080-b161-22d89b9c7d0a req-5672cf0a-7fca-44fc-b295-5569dc872b5a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031049 Jul 20 14:28:30.685928 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1443/3087] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:30:28.047717 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_api:SELECT=20 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:28.048492 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell1:SELECT=44 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:28.053057 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:28.053557 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:28.060395 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:28.060848 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:28.061620 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:28.062056 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:28.086996 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Going to try to terminate instance {{(pid=129541) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 14:30:28.165065 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-9c1a1617-d7d6-4f76-9a8c-04fdfd5866ea tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "DELETE /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 204 len: 0 microversion: 2.1 time: 0.118724 Jul 20 14:30:28.165672 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1645/3088] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jul 20 14:30:28 2022] DELETE /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 14:30:28.172139 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1da21261-6da5-4cc1-b35f-e2e1a7235725] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 14:30:28.172771 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:28.173504 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell1:SELECT=48 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:28.178524 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:28.179228 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:28.188802 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:28.189254 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:28.190022 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:28.190457 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:28.327774 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:28.336423 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-b84ba9b0-edcd-4928-bd2a-0efad4d89904 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1577 microversion: 2.1 time: 0.166169 Jul 20 14:30:28.336994 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1444/3089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:28 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:29.354683 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:29.355405 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:29.362385 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:29.363409 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:29.364181 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:29.364641 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:29.513373 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:29.521432 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-1c0dce6a-32de-4fd1-8681-3ab89d2507e4 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1577 microversion: 2.1 time: 0.170994 Jul 20 14:30:29.522009 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1646/3090] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:29 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:30.539128 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:30.540241 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:30.547658 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:30.548100 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:30.548901 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:30.549492 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:30.569159 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] [1da21261-6da5-4cc1-b35f-e2e1a7235725] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 36614. Jul 20 14:30:30.622745 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:30.632409 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-c53cc527-f79f-4b4a-8baf-f6a7be134f28 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 200 len: 1510 microversion: 2.1 time: 0.096975 Jul 20 14:30:30.633359 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1445/3091] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:30 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:30.961390 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-feef0cce-1b40-4554-bb52-4d7e87b58604 req-a0a9a1b7-a121-493d-8e0f-9fcce6c62637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103db46f-9fbe-47a3-97f7-c64229d266a8", "name": "network-vif-deleted", "tag": "6ebed62b-80ba-4cad-aa82-7c340d5c0572"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:30:30.984880 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-feef0cce-1b40-4554-bb52-4d7e87b58604 req-a0a9a1b7-a121-493d-8e0f-9fcce6c62637 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:30.985327 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-feef0cce-1b40-4554-bb52-4d7e87b58604 req-a0a9a1b7-a121-493d-8e0f-9fcce6c62637 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:30.999183 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-feef0cce-1b40-4554-bb52-4d7e87b58604 req-a0a9a1b7-a121-493d-8e0f-9fcce6c62637 service nova] Creating event network-vif-deleted:6ebed62b-80ba-4cad-aa82-7c340d5c0572 for instance 103db46f-9fbe-47a3-97f7-c64229d266a8 on hv-cinder-81914 Jul 20 14:30:31.005638 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-feef0cce-1b40-4554-bb52-4d7e87b58604 req-a0a9a1b7-a121-493d-8e0f-9fcce6c62637 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129807 Jul 20 14:30:31.006241 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1647/3092] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:30:31.649651 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:31.651149 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 103db46f-9fbe-47a3-97f7-c64229d266a8] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:31.659138 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:31.660098 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:31.660909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:31.661344 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:31.675654 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.wsgi [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] HTTP exception thrown: Instance 103db46f-9fbe-47a3-97f7-c64229d266a8 could not be found. Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Request method failure captured: Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: request: GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 HTTP/1.1 Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept: application/json Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Accept-Encoding: identity Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Connection: close Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Length: 0 Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Content-Type: application/json Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Host: 10.222.0.17 Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Openstack-System-Scope: None Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: User-Agent: python-urllib3/1.26.9 Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Auth-Token: gAAAAABi2BDlo16e_oIF1z91SZauzxOcAbaWPheeVsrRop87TxVS2I4EiUk-CkcfpSuxKVbe38RtDEuj0MS3Dgp9J6OJ63WEmbDuB-oKFU0n3_rg50FXF3YSRV36J24jogSSErzJ_69vIb9-uQvoUWfscBCHkDchnp1HlRnu0OD3EN1-5U9IK7E Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Id: None Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Domain-Name: None Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Identity-Status: Confirmed Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Is-Admin-Project: True Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Id: default Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Domain-Name: Default Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Id: 4c581a98139043aea10590f609772f5f Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Project-Name: tempest-TestVolumeBootPattern-225795191 Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Role: member,reader Jul 20 14:30:31.677595 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Roles: member,reader Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c581a98139043aea10590f609772f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c581a98139043aea10590f609772f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c581a98139043aea10590f609772f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c581a98139043aea10590f609772f5f"}]}] Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant: tempest-TestVolumeBootPattern-225795191 Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Id: 4c581a98139043aea10590f609772f5f Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-Tenant-Name: tempest-TestVolumeBootPattern-225795191 Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User: tempest-TestVolumeBootPattern-225795191-project Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Id: default Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Domain-Name: Default Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Id: 19108692061f4d73a085081d39d0f547 Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: X-User-Name: tempest-TestVolumeBootPattern-225795191-project Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: method: > Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: exception: Instance 103db46f-9fbe-47a3-97f7-c64229d266a8 could not be found. Jul 20 14:30:31.678915 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: action_args: {'id': '103db46f-9fbe-47a3-97f7-c64229d266a8'} Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103db46f-9fbe-47a3-97f7-c64229d266a8 could not be found. Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 14:30:31.679578 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103db46f-9fbe-47a3-97f7-c64229d266a8 could not be found. Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103db46f-9fbe-47a3-97f7-c64229d266a8 could not be found. Jul 20 14:30:31.680637 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: ERROR nova.api.openstack.wsgi Jul 20 14:30:31.681811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Returning 404 to user: Instance 103db46f-9fbe-47a3-97f7-c64229d266a8 could not be found. {{(pid=129542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 14:30:31.681811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a37d9f30-f498-4dbb-822a-68eebe0502dd tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8" status: 404 len: 111 microversion: 2.1 time: 0.033623 Jul 20 14:30:31.681811 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1446/3093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:31 2022] GET /compute/v2.1/servers/103db46f-9fbe-47a3-97f7-c64229d266a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 14:30:31.728523 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1732807017", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1122089618", "security_groups": [{"name": "tempest-secgroup-smoke-344139019"}], "block_device_mapping_v2": [{"uuid": "475d0fc3-718c-4774-9200-555f7bcd0e5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daa9f12b-0276-4a15-a781-c9be024bf6c1"}]}} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:30:31.854067 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.network.neutron [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] validate_networks() for [('daa9f12b-0276-4a15-a781-c9be024bf6c1', None, None, None, None, None)] {{(pid=129541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 14:30:32.326104 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Flavor limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 14:30:32.326745 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Image limits 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 14:30:32.327013 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Flavor pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 14:30:32.327488 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Image pref 0:0:0 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 14:30:32.327902 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.virt.hardware [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 14:30:32.338108 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:32.338740 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:32.339529 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:32.339958 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:32.357006 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Getting quotas for project 4c581a98139043aea10590f609772f5f. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 14:30:32.361275 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.quota [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Getting quotas for user 19108692061f4d73a085081d39d0f547 and project 4c581a98139043aea10590f609772f5f. Resources: {'ram', 'instances', 'cores'} {{(pid=129541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 14:30:32.427868 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Going to run 1 instances... {{(pid=129541) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 14:30:32.430058 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='475d0fc3-718c-4774-9200-555f7bcd0e5f',volume_size=None,volume_type=None)] {{(pid=129541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 14:30:32.559285 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [6376ae06-ea71-4998-88f8-2b004b155df8] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 14:30:33.568040 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [6376ae06-ea71-4998-88f8-2b004b155df8] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 36642. Jul 20 14:30:33.572126 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-bbe6d3c8-41aa-49f7-b936-124bd34f6333 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.848108 Jul 20 14:30:33.572955 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1648/3094] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jul 20 14:30:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 14:30:33.583143 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-332bb246-02fb-47ce-aa73-1d99456e4aae tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:33.583749 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-332bb246-02fb-47ce-aa73-1d99456e4aae tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:33.642583 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-332bb246-02fb-47ce-aa73-1d99456e4aae tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:33.650800 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-332bb246-02fb-47ce-aa73-1d99456e4aae tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1095 microversion: 2.1 time: 0.071489 Jul 20 14:30:33.651369 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1447/3095] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:33 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:34.330582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:30:34.330582 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:30:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:30:34.668481 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-106857bd-3867-4e69-81bd-76ed72893b2c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:34.669156 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-106857bd-3867-4e69-81bd-76ed72893b2c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:34.723820 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-106857bd-3867-4e69-81bd-76ed72893b2c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:34.731292 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-106857bd-3867-4e69-81bd-76ed72893b2c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1095 microversion: 2.1 time: 0.067599 Jul 20 14:30:34.731869 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1649/3096] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:34 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:35.748110 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-8dcba510-a8ff-4572-9482-f6115fd81076 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:35.748893 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-8dcba510-a8ff-4572-9482-f6115fd81076 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:35.803449 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-8dcba510-a8ff-4572-9482-f6115fd81076 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:35.810183 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-8dcba510-a8ff-4572-9482-f6115fd81076 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1095 microversion: 2.1 time: 0.066164 Jul 20 14:30:35.810738 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1448/3097] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:35 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:36.831709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-8902c260-0e9e-4d83-b6ba-f2e042a4b7f5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:36.833061 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-8902c260-0e9e-4d83-b6ba-f2e042a4b7f5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:36.904893 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-8902c260-0e9e-4d83-b6ba-f2e042a4b7f5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:36.912546 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-8902c260-0e9e-4d83-b6ba-f2e042a4b7f5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1095 microversion: 2.1 time: 0.088456 Jul 20 14:30:36.913127 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1650/3098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:36 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:37.929999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:37.930618 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:37.937500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:37.937948 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:37.938733 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:37.939170 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:38.010004 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:38.018949 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-44b3dd0a-2d76-45a0-acc1-f464a7731fc7 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1145 microversion: 2.1 time: 0.092207 Jul 20 14:30:38.019724 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1449/3099] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:37 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:39.036407 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:39.037137 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:39.044777 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:39.045232 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:39.046043 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:39.046561 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:39.123597 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:39.132243 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-337e848c-52ce-4b81-8493-930d2c639be2 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1211 microversion: 2.1 time: 0.100033 Jul 20 14:30:39.132889 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1651/3100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:39 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:40.110480 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [req-67b4da4c-bdc1-4f55-b691-a1c5d67a25e9 req-df512e7a-412f-4a1d-8313-8d3ebb349f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c6195a-0b3f-4d20-9727-65e03fc3fb91", "tag": "b7949ab7-f9ee-4d04-8f96-9930f3bb7f55"}]} {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:30:40.124518 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-67b4da4c-bdc1-4f55-b691-a1c5d67a25e9 req-df512e7a-412f-4a1d-8313-8d3ebb349f9f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:40.125071 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [req-67b4da4c-bdc1-4f55-b691-a1c5d67a25e9 req-df512e7a-412f-4a1d-8313-8d3ebb349f9f service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:40.142404 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.compute.server_external_events [req-67b4da4c-bdc1-4f55-b691-a1c5d67a25e9 req-df512e7a-412f-4a1d-8313-8d3ebb349f9f service nova] Creating event network-changed:b7949ab7-f9ee-4d04-8f96-9930f3bb7f55 for instance 06c6195a-0b3f-4d20-9727-65e03fc3fb91 on hv-cinder-81914 Jul 20 14:30:40.149780 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:40.150836 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:40.158433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [req-67b4da4c-bdc1-4f55-b691-a1c5d67a25e9 req-df512e7a-412f-4a1d-8313-8d3ebb349f9f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051715 Jul 20 14:30:40.159691 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:40.159909 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1450/3101] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:30:40.160147 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:40.161017 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:40.161450 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:40.395301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:40.403132 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-4a034c27-235d-4a67-91ed-8e1f32f1e436 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.257144 Jul 20 14:30:40.403716 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1652/3102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:40 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 14:30:41.421799 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:41.422530 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:41.428870 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:41.429320 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:41.430079 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:41.430512 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:41.566403 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:41.573884 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-f9e7e961-ee90-4be9-ad35-db1a0d6098d8 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.156783 Jul 20 14:30:41.574440 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1451/3103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:41 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:42.591819 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:42.592422 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:42.594439 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=2 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:42.600678 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:42.601117 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:42.601883 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:42.602312 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:42.734866 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:42.742281 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-6894ff1c-ee53-4de8-acd1-65ca5558e646 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.154461 Jul 20 14:30:42.742980 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1653/3104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:42 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:43.757999 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:43.758614 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:43.765051 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:43.765491 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:43.766249 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:43.766670 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:43.903494 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:43.911851 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-56a09633-8a6d-48a2-8513-dbeea25f5cd5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.157634 Jul 20 14:30:43.912463 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1452/3105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:43 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:44.928970 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:44.929575 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:44.936185 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:44.936662 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:44.937415 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:44.937851 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:45.074486 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:45.082675 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-06c1fd17-c9dc-4b89-a353-4e409a17091f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.158163 Jul 20 14:30:45.083274 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1654/3106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:44 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:46.099982 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:46.100592 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:46.102975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG dbcounter [-] [129542] Writing DB stats nova_cell0:SELECT=4 {{(pid=129542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:46.108623 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:46.109067 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:46.109824 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:46.110252 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:46.246284 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:46.253715 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a9fb48be-deb1-4d50-9da2-90927ae9f63d tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.158085 Jul 20 14:30:46.254275 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1453/3107] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:46 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:47.270533 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:47.271175 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:47.273532 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG dbcounter [-] [129541] Writing DB stats nova_cell0:SELECT=10 {{(pid=129541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:47.278929 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:47.279376 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:47.280145 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:47.280607 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:47.413545 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:47.420986 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-d52ba293-1352-47d5-bdcf-5f815eea68b5 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.154341 Jul 20 14:30:47.421540 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1655/3108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:47 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:48.438410 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:48.439026 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:48.446761 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:48.447215 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:48.447977 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:48.448514 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:48.581874 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:48.589612 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-914b167b-0277-43c4-822a-921a616eb312 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.155008 Jul 20 14:30:48.590181 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1454/3109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:48 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:49.608589 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:49.609195 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:49.616258 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:49.616709 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:49.617497 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:49.617928 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:49.749790 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:49.757194 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-e11cfe2d-1c79-456c-a3eb-c7d29356d666 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.152484 Jul 20 14:30:49.757755 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1656/3110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:49 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:50.773990 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:50.774829 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:50.782213 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:50.782665 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:50.783451 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:50.784500 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:50.930243 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:50.938465 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-ac513a75-f808-40bb-8a1f-455d7d8aab8f tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.168261 Jul 20 14:30:50.939065 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1455/3111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:50 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:51.009379 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-4109f902-1939-4dec-8e5f-c5d4f90bf1c5 req-c9b1ed0b-9d33-426e-ba09-441600c4f877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c6195a-0b3f-4d20-9727-65e03fc3fb91", "name": "network-vif-plugged", "status": "completed", "tag": "b7949ab7-f9ee-4d04-8f96-9930f3bb7f55"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:30:51.019019 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-4109f902-1939-4dec-8e5f-c5d4f90bf1c5 req-c9b1ed0b-9d33-426e-ba09-441600c4f877 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:51.019456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-4109f902-1939-4dec-8e5f-c5d4f90bf1c5 req-c9b1ed0b-9d33-426e-ba09-441600c4f877 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:51.031477 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-4109f902-1939-4dec-8e5f-c5d4f90bf1c5 req-c9b1ed0b-9d33-426e-ba09-441600c4f877 service nova] Creating event network-vif-plugged:b7949ab7-f9ee-4d04-8f96-9930f3bb7f55 for instance 06c6195a-0b3f-4d20-9727-65e03fc3fb91 on hv-cinder-81914 Jul 20 14:30:51.037284 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-4109f902-1939-4dec-8e5f-c5d4f90bf1c5 req-c9b1ed0b-9d33-426e-ba09-441600c4f877 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031477 Jul 20 14:30:51.037954 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1657/3112] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 14:30:51.956783 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:51.957389 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:51.964265 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:51.964721 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:51.965490 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:51.965927 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:52.098975 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:52.106433 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-73fc53ed-98d4-4fd5-8f3e-54574d64eefe tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1266 microversion: 2.1 time: 0.153842 Jul 20 14:30:52.106991 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1456/3113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:51 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:53.125118 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:53.125818 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.compute.api [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129541) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:53.132798 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:53.133227 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:53.134045 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:53.134456 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:53.274736 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.policy [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129541) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:53.284584 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [None req-a3cc6a23-a138-4d59-8012-3f9e6c1e9022 tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1452 microversion: 2.1 time: 0.164313 Jul 20 14:30:53.285169 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1658/3114] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:53 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:53.302788 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.api.openstack.wsgi [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Calling method '>' {{(pid=129542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 14:30:53.303393 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.compute.api [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] [instance: 06c6195a-0b3f-4d20-9727-65e03fc3fb91] Fetching instance by UUID {{(pid=129542) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 14:30:53.309781 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:53.310264 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:53.311219 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:53.311667 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG oslo_concurrency.lockutils [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:53.452225 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: DEBUG nova.policy [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19108692061f4d73a085081d39d0f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c581a98139043aea10590f609772f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129542) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 14:30:53.460045 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO nova.api.openstack.requestlog [None req-a9f69109-1535-43a4-913b-fb018edea81c tempest-TestVolumeBootPattern-225795191 tempest-TestVolumeBootPattern-225795191-project] 10.222.0.17 "GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91" status: 200 len: 1452 microversion: 2.1 time: 0.162931 Jul 20 14:30:53.460638 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: [pid: 129542|app: 0|req: 1457/3115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jul 20 14:30:53 2022] GET /compute/v2.1/servers/06c6195a-0b3f-4d20-9727-65e03fc3fb91 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 14:30:55.329650 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG nova.api.openstack.wsgi [req-71c09918-1da7-43b4-96d4-f7afb3878580 req-6d22c51b-6705-4474-8870-e2553a1709f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c6195a-0b3f-4d20-9727-65e03fc3fb91", "tag": "b7949ab7-f9ee-4d04-8f96-9930f3bb7f55"}]} {{(pid=129541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 14:30:55.337867 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-71c09918-1da7-43b4-96d4-f7afb3878580 req-6d22c51b-6705-4474-8870-e2553a1709f7 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 14:30:55.338304 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: DEBUG oslo_concurrency.lockutils [req-71c09918-1da7-43b4-96d4-f7afb3878580 req-6d22c51b-6705-4474-8870-e2553a1709f7 service nova] Lock "6fdd732e-d85d-4c48-8292-9a17203a2e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 14:30:55.349463 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.compute.server_external_events [req-71c09918-1da7-43b4-96d4-f7afb3878580 req-6d22c51b-6705-4474-8870-e2553a1709f7 service nova] Creating event network-changed:b7949ab7-f9ee-4d04-8f96-9930f3bb7f55 for instance 06c6195a-0b3f-4d20-9727-65e03fc3fb91 on hv-cinder-81914 Jul 20 14:30:55.354627 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO nova.api.openstack.requestlog [req-71c09918-1da7-43b4-96d4-f7afb3878580 req-6d22c51b-6705-4474-8870-e2553a1709f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029118 Jul 20 14:30:55.355214 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: [pid: 129541|app: 0|req: 1659/3116] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jul 20 14:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 14:32:05.920756 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:32:05.921345 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:33:54.340424 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:33:54.341062 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:33:56.043475 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:33:56.044090 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:33:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:34:13.884681 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:34:13.885288 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:35:25.929801 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:35:25.930429 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:35:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:35:33.850301 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:35:33.850940 dv-cinder-819149-11-iscsi devstack@n-api.service[129541]: Wed Jul 20 14:35:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 14:35:54.746742 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 14:35:54.747368 dv-cinder-819149-11-iscsi devstack@n-api.service[129542]: Wed Jul 20 14:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!